-- Logs begin at Tue 2022-06-21 14:56:17 UTC, end at Tue 2022-06-21 16:21:59 UTC. -- Jun 21 15:43:00.592965 dv-cinder-840678-13-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 21 15:43:00.603040 dv-cinder-840678-13-smb devstack@keystone.service[80224]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 15:43:00 2022] *** Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: nodename: dv-cinder-840678-13-smb Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: machine: x86_64 Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: clock source: unix Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: pcre jit disabled Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: detected number of CPU cores: 4 Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: current working directory: / Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: detected binary path: /usr/bin/uwsgi-core Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: your processes number limit is 47680 Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: your memory page size is 4096 bytes Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: detected max file descriptor number: 2048 Jun 21 15:43:00.605159 dv-cinder-840678-13-smb devstack@keystone.service[80224]: lock engine: pthread robust mutexes Jun 21 15:43:00.606169 dv-cinder-840678-13-smb devstack@keystone.service[80224]: thunder lock: enabled Jun 21 15:43:00.606169 dv-cinder-840678-13-smb devstack@keystone.service[80224]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 21 15:43:00.606169 dv-cinder-840678-13-smb devstack@keystone.service[80224]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 15:43:00.650600 dv-cinder-840678-13-smb devstack@keystone.service[80224]: Python main interpreter initialized at 0x55be5084f9c0 Jun 21 15:43:00.650600 dv-cinder-840678-13-smb devstack@keystone.service[80224]: python threads support enabled Jun 21 15:43:00.650600 dv-cinder-840678-13-smb devstack@keystone.service[80224]: your server socket listen backlog is limited to 100 connections Jun 21 15:43:00.650600 dv-cinder-840678-13-smb devstack@keystone.service[80224]: your mercy for graceful operations on workers is 90 seconds Jun 21 15:43:00.650927 dv-cinder-840678-13-smb devstack@keystone.service[80224]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 15:43:00.651024 dv-cinder-840678-13-smb devstack@keystone.service[80224]: *** Operational MODE: preforking *** Jun 21 15:43:00.651325 dv-cinder-840678-13-smb devstack@keystone.service[80224]: *** uWSGI is running in multiple interpreter mode *** Jun 21 15:43:00.651325 dv-cinder-840678-13-smb devstack@keystone.service[80224]: spawned uWSGI master process (pid: 80224) Jun 21 15:43:00.651534 dv-cinder-840678-13-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 21 15:43:00.655189 dv-cinder-840678-13-smb devstack@keystone.service[80224]: spawned uWSGI worker 1 (pid: 80234, cores: 1) Jun 21 15:43:00.655189 dv-cinder-840678-13-smb devstack@keystone.service[80224]: spawned uWSGI worker 2 (pid: 80235, cores: 1) Jun 21 15:43:00.655189 dv-cinder-840678-13-smb devstack@keystone.service[80224]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 15:43:06.376461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:43:06.376461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: from cryptography.utils import int_from_bytes Jun 21 15:43:06.377215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:43:06.377215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: from cryptography.utils import int_from_bytes Jun 21 15:43:06.379181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:43:06.379181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: from cryptography.utils import int_from_bytes Jun 21 15:43:06.379628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 15:43:06.379628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: from cryptography.utils import int_from_bytes Jun 21 15:43:06.427883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 15:43:06.428116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 15:43:06.428208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] command line args: [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 15:43:06.428472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 15:43:06.428657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ================================================================================ {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 15:43:06.428878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 15:43:06.428964 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] admin_token = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.429082 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 15:43:06.429165 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] config_dir = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.429284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] command line args: [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 15:43:06.429372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.429506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] config_source = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.429581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 15:43:06.429690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] debug = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.429772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ================================================================================ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 15:43:06.429894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.430142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] admin_token = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.430204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_dir = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.430266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.430394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.430498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.430603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_source = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.430708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.430800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] debug = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.430921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.431029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.431200 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.431313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.431414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] log_config_append = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.431513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.431618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.431720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.431822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] log_dir = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.431915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.432019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] log_file = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.432113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.432215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.432298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_config_append = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.432376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.432488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.432566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.432684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_dir = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.432756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.433071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.433071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.433744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.433821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.433935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.434045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.434129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.434327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.434412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.434514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.434645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.434720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.434888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.435005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.435116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.435242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.435384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.435510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.435642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.435756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.435865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.435974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.436094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.436204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.436348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.436608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.436722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.436837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] publish_errors = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.436958 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.437078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.437280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.437398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.437521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.437639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] publish_errors = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.437755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.437865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.437980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.438092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.438220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] standard_threads = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.438337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.438448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.438556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.438715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.438829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.438939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.439047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] standard_threads = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.439177 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] use_journal = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.439290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.439415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] use_json = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.439415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] use_stderr = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.439632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.439742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] use_syslog = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.439851 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.439851 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_journal = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.440070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.440183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_json = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.440293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.440408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_stderr = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.440408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_syslog = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.440630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.440741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 15:43:06.440851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.440960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.441075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.441193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.441312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.441423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.441539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.441650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.441760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.441860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.441961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.442072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.442183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.442293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.442403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.442517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.442637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.442748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.442854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.442969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.443086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.443086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.443326 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.443447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.443558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.443671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.443787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.443899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.444084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.444198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.444307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.444307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.444519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.444636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.444760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.444760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.444981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.445091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.445199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.445314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.445437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.445549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.445658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.445767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.445876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.445990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.446111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.446223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.446332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.446442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.446553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.446663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.446780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.446891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.447000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.447109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.447261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.447373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.447495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.447608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.447796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.447935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.448055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.448174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.448286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.448395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.448542 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.448691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.448876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.448876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.449194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.449308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.449419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.449528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.449639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.449826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.449946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.450064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.450175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.450290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.450290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.450506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.450624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.450736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.450845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.450960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.451077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.451215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.451336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.451447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.451556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.451665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.451774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.451891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.452002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.452112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.452221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.452330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.452438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.452555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.452666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.452783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.452883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.452977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.453103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.453209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.453302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.453395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.453487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.453585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.453685 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.453788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.453910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.454013 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.454155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.454269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.454376 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.454499 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.454619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.454733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.454856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.454968 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.455088 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.455245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.455372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.455485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.455607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.455726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.455828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.455938 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.456049 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.456167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.456279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.456390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.456510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.456623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.456777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.456901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.457014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.457125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.457268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.457383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.457493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.457611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.457723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.457833 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.457977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.458093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.458211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.458312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.458452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.458565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.458697 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.458816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.458937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.459051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.459179 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.459291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.459428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.459543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.459666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.459778 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.459889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.459999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.460117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.460229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.460348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.460460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.460614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.460736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.460849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.460958 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.461147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.461263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.461375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.461485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.461595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.461705 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.461823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.461945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.462069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.462183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.462306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.462420 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.462532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.462641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.462760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.462873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.462984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.463094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.463225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.463338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.463460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.463580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.463698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.463810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.463921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.464031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.464199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.464344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.464458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.464627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.464760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.464872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.464993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.465107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.external = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.465219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.465331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.465442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.external = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.465552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.465672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.465820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.465950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.466076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.password = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.466190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.466301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] auth.token = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.466414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.password = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.466537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.466652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.token = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.466763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.466874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.466985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.467096 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.467246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.467363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.467476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.467587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.467698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.467816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.467941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.468055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.468168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.468280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.468391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.468503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.468622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.468736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.468848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.468960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.469077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.469190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.469310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.469424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.469542 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.469656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.469767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.469879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.469998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.470112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.470224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.470342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.470486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.470605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.470783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.470902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.471038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.471155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.471345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.471457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.471581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.471697 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.471832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.471949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.472061 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.472173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.472294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.472408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.472545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.472672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.472786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.472897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.473017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.473131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.473249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.473362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.473496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.473611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.473734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.473852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.473966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.474079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.474216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.474342 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.474464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.474577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.474690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.474803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.474914 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.475035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.475274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.475393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.475505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.475618 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.475729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.475843 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.475963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.476078 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.476190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.476301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.476413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.476536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.476651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.476763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.476876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.476987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.477098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.477218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.477331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.477443 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.477554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.477656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.477766 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.477886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.478001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.478113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.478224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.478336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.478447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.478567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.478680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.478799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.478935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.479053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.479226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.479356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.479471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.479583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.480248 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.480373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.480486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.480607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.480754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.480870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.480983 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.481096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.481208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.481328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.481442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.481561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.481675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.481787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.481899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.482024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.482139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.482252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.482363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.482475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.482620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.482745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.482867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.482979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.483091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.483265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.483380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.483507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.483622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.483735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.483846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.483957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.484069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.484190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.484304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.484416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.484528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.484639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.484751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.484870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.484984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.485096 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.485213 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.485312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.485447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.485573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.485688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.485798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.485916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.486027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.486161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.486287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.486401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.486512 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.486647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.486764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.486876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.486995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.487111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.487243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.487357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.487452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.487590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.487681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.487837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.487915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.488083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.488159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.488325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.488409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.488577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.488662 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.488826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.488905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.489079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.489158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.489320 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.489398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.489579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.489662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.489784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.489869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.491233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.491325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.491399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.491482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.491567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.491640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.491640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.491767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.491767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.492280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.492583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.492666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.492738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.492808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.492878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.493110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.493416 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.493503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.493503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.493633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.493703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.493827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.493952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.494068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.494181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.494293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.494404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.494517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.494636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.494753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.494865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.494977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.494977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.495206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.495206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.496064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.496064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.496284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.496397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.496508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.496630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.496744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.496857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.496970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.497082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.497194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.497194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.497415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.497415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.497609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.497704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.497800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.497920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.498034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.498146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.498257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.498369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.498480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.498600 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.498714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.498714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.498926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.499037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.499148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.499351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.499466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.499578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.499690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.499794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.499894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.500082 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.500199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.500311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.500427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.500539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.500651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] role.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.500772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.500886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] role.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.500999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.501112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.501223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.501335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.501455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.501569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.501682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.501794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.501906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.502026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.502148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.502262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.502374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.502486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.502597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.502717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.502831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.502944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.503056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.503186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.503302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.503427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.503541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.503654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.503766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.503879 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.503991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.504112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.504227 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.504340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.504452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.504564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.504675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.504795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.504909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.505022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.505133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.505246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.505358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.505478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.505593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.505705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.505817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.505929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.506041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.506161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.506277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.506389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.506501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.506613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.506726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.506846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.506960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.507073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.507232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.507349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.507461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.507586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.507701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.507813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.507925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.508038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.508158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.508272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.508385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.508497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.508607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.508719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] token.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.508839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.508953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.509064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.509175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.509287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.509400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.509519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.509633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.509745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.509857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.509969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.510080 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.510205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.510319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.510437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.510549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.510660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.510772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.510891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.511049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.511178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.511293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.511405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.511519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.511703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.511826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.511826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.512038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.512151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.512263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.512384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.512500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.512613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.512724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.512836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.connection = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.512956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.513079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.513192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.513576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.513705 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.513820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.513933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.514045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.514158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.514270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.514389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.514504 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.514617 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.514729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.514848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.514945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.515049 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.515191 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.515308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.515421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.515532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.515645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.515770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.515885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.515998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.516110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.516222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.516335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.516454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.516574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.516688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.516801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.516913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.517025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.517145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.517259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.517371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.517483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 15:43:06.517595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 15:43:06.517595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 15:43:06.550837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.551035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.551121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.551224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.551303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.551479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.560372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.560506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.588734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.588969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.589743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.590033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.736384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.737551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.786022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.786241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.787647 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.787893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.851476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.851706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.851797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.851934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.852023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.852159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.852243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.852382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.852472 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.852601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.852682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.852818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.879408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.879605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.879748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.879829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.879899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.880047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.880129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.880277 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.880361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.880541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.880631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.880706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.880788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.880943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.893259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.893425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.906195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.906460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.906597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.906673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.906749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.906882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.906976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.907109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.907208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.907353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.907491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.907572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.907718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.907939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80235) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 15:43:06.925441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.925691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 15:43:06.925851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.925991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 15:43:06.926074 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.926198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 15:43:06.926337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.926473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.926554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 15:43:06.926739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.926821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.927000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.927080 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.927284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.927380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.927593 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.938903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.939380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.939484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.939734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.939952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.940034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.940288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.940372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.948921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:06.949327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:06.952300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:06.952391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:06.952589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.952688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.952878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.952961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.953167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.953248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.953455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.953547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.953723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.953804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.953996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.954076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.954273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.954354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.954545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.954627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.954821 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.954909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.955091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.955193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.982215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.982642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.983941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:06.984229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.984312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:06.984583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.989594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:06.989904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:06.989997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.990231 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.990312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.990580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.998173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:06.998457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:06.998622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:06.998911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.002994 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.003309 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.003490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.003589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.003783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.003865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.004069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.004150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.004357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.004440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.004636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.004716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.004916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.005006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.005192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.005466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.024465 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.024755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.025552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.025847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.029567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.030707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.033264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.033670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.034573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.034979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.038778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.040115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.043015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.044400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.046911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.047240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.047530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.047818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.048096 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.048183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.048378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.048459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.048701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.048993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.049278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.049564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.068259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.068555 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.068830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.069108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.069551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.069843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.070126 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.070402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.077103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.078622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.078871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.079201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.080365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.080643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.082471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.082761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.083052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.083370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.083659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.083959 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.084268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.084576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.084885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.085185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.097168 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.097457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.097756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.098043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.098763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.099055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.099365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.099650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.099747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.100120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.100359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.101355 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.101658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.101963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.118970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.121207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.123020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.124700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.126373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.128080 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.128189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.129789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.129871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.130074 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.130442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.131501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.131783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.132083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.137912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.139838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.139967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.141589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.143110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.143426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.143825 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.144110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.144944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.145238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.145634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.145922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.153355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.153644 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.153931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.155282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.155575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.155859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.161905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.162206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.162498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.162798 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.163077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.163490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.163777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.163858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80235) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 15:43:07.164069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.164151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.164346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.164435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.164629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.164711 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.164902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.165031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.165171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.165281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.165453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.165564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.165736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.165857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.166136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.166413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.166690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.166969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.167856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.168091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80235) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 15:43:07.205316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55be5084f9c0 pid: 80234 (default app) Jun 21 15:43:07.208748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96fc12-8785-425c-a9c3-22781d0715ac None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:07.208936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55be5084f9c0 pid: 80235 (default app) Jun 21 15:43:07.209054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96fc12-8785-425c-a9c3-22781d0715ac None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:07.209347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96fc12-8785-425c-a9c3-22781d0715ac None None] PATH_INFO: `/v3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:07.213581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Tue Jun 21 15:43:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:15.088684 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2799db-30bb-4633-892e-4edf3b569c20 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:15.089315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2799db-30bb-4633-892e-4edf3b569c20 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:15.089408 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2799db-30bb-4633-892e-4edf3b569c20 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:15.093873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:43:15.099514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:15.099935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:15.100086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:15.171317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: INFO dbcounter [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] Registered counter for database keystone Jun 21 15:43:15.192875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG oslo_db.sqlalchemy.engines [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:43:15.199264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writer thread running {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:43:15.381928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG passlib.handlers.bcrypt [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80234) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 15:43:15.382363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG passlib.handlers.bcrypt [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80234) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 15:43:15.437648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:15.439336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:15.565023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 15:43:15.695882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2799db-30bb-4633-892e-4edf3b569c20 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:15.771355 dv-cinder-840678-13-smb devstack@keystone.service[80235]: INFO dbcounter [None req-ec2799db-30bb-4633-892e-4edf3b569c20 None None] Registered counter for database keystone Jun 21 15:43:15.791485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG oslo_db.sqlalchemy.engines [None req-ec2799db-30bb-4633-892e-4edf3b569c20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 15:43:15.798522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writer thread running {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 15:43:15.926465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2799db-30bb-4633-892e-4edf3b569c20 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:15.930882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cc714-28ad-41c3-9d05-5be58ca7360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:15.931594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cc714-28ad-41c3-9d05-5be58ca7360f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:15.931888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cc714-28ad-41c3-9d05-5be58ca7360f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:15.932181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cc714-28ad-41c3-9d05-5be58ca7360f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:15.942034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cc714-28ad-41c3-9d05-5be58ca7360f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:15.994715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: WARNING keystone.common.rbac_enforcer.enforcer [None req-554cc714-28ad-41c3-9d05-5be58ca7360f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 15:43:15.995746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cc714-28ad-41c3-9d05-5be58ca7360f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:16.006230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Tue Jun 21 15:43:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 15:43:16.012290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:16.028174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de7fef-00b8-4f26-9b88-57789a1ef291 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:16.032616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309ac01-1030-4722-bf8d-5511e022db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:16.033729 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ac01-1030-4722-bf8d-5511e022db0d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:16.034023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ac01-1030-4722-bf8d-5511e022db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:16.034306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ac01-1030-4722-bf8d-5511e022db0d admin admin] PATH_INFO: `/v3/projects/f406bc3b64324ae8acf4eaa5547534ca` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:16.038517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309ac01-1030-4722-bf8d-5511e022db0d admin admin] RBAC: Authorizing `identity:get_project(project_id=f406bc3b64324ae8acf4eaa5547534ca)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:16.090163 dv-cinder-840678-13-smb devstack@keystone.service[80234]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4309ac01-1030-4722-bf8d-5511e022db0d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 15:43:16.090516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309ac01-1030-4722-bf8d-5511e022db0d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:16.095149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Tue Jun 21 15:43:16 2022] GET /identity/v3/projects/f406bc3b64324ae8acf4eaa5547534ca => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:18.109719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9986-9d2d-4165-91a1-b52884b53e62 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:18.110236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9986-9d2d-4165-91a1-b52884b53e62 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:18.110387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9986-9d2d-4165-91a1-b52884b53e62 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:18.114453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:18.119897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2488e-6d07-407f-9e80-109453d4168b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:18.120368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2488e-6d07-407f-9e80-109453d4168b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:18.120521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2488e-6d07-407f-9e80-109453d4168b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:18.139535 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-65f2488e-6d07-407f-9e80-109453d4168b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:18.141075 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65f2488e-6d07-407f-9e80-109453d4168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:18.149582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 15:43:18.173226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f9986-9d2d-4165-91a1-b52884b53e62 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:18.185650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f9986-9d2d-4165-91a1-b52884b53e62 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:18.189987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b31af3-a238-4e0e-9364-e009af7735df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:18.190637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31af3-a238-4e0e-9364-e009af7735df admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:18.190926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31af3-a238-4e0e-9364-e009af7735df admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:18.191231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31af3-a238-4e0e-9364-e009af7735df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:18.200024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b31af3-a238-4e0e-9364-e009af7735df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:18.201829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b31af3-a238-4e0e-9364-e009af7735df admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:18.210663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Tue Jun 21 15:43:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 15:43:18.217088 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2488e-6d07-407f-9e80-109453d4168b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:18.226183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2488e-6d07-407f-9e80-109453d4168b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:18.230727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f15909-cd75-481a-ae6a-2f1a0d1179be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:18.231619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f15909-cd75-481a-ae6a-2f1a0d1179be admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:18.231909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f15909-cd75-481a-ae6a-2f1a0d1179be admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:18.232187 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f15909-cd75-481a-ae6a-2f1a0d1179be admin admin] PATH_INFO: `/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:18.233572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f15909-cd75-481a-ae6a-2f1a0d1179be admin admin] RBAC: Authorizing `identity:get_user(user_id=0a08a935c7f043a7a9ef4df0003ddf4c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:18.235450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f15909-cd75-481a-ae6a-2f1a0d1179be admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:18.237032 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Tue Jun 21 15:43:18 2022] GET /identity/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:20.423937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e36c71-cf71-4178-a29e-e28a8df662af None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:20.424447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e36c71-cf71-4178-a29e-e28a8df662af None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:20.424546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e36c71-cf71-4178-a29e-e28a8df662af None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:20.425866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:20.431100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c02373-ca86-4094-b097-7a789fbb94ab None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:20.431538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c02373-ca86-4094-b097-7a789fbb94ab None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:20.431718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c02373-ca86-4094-b097-7a789fbb94ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:20.449105 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e6c02373-ca86-4094-b097-7a789fbb94ab None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:20.450247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79631b24-6245-4c20-88df-b866364b14ba None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:20.450356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6c02373-ca86-4094-b097-7a789fbb94ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:20.450545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79631b24-6245-4c20-88df-b866364b14ba None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:20.450831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79631b24-6245-4c20-88df-b866364b14ba None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:20.452237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:43:20.457524 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83205b-a145-452a-b8fb-b7d46baec6ba None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:20.457812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83205b-a145-452a-b8fb-b7d46baec6ba None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:20.458091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83205b-a145-452a-b8fb-b7d46baec6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:20.498763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG passlib.handlers.bcrypt [None req-5d83205b-a145-452a-b8fb-b7d46baec6ba None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80235) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 15:43:20.499194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG passlib.handlers.bcrypt [None req-5d83205b-a145-452a-b8fb-b7d46baec6ba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80235) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 15:43:20.536282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:20.545732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5d83205b-a145-452a-b8fb-b7d46baec6ba None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:20.547387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5d83205b-a145-452a-b8fb-b7d46baec6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:20.560286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c02373-ca86-4094-b097-7a789fbb94ab None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:20.583809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:20.651884 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:43:20.665494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c02373-ca86-4094-b097-7a789fbb94ab None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:20.675786 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83205b-a145-452a-b8fb-b7d46baec6ba None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:20.702489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727362ac-bedf-4334-84c4-94f998a00554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:20.703323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727362ac-bedf-4334-84c4-94f998a00554 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:20.703616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727362ac-bedf-4334-84c4-94f998a00554 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:20.703890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727362ac-bedf-4334-84c4-94f998a00554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:20.715253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727362ac-bedf-4334-84c4-94f998a00554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-727362ac-bedf-4334-84c4-94f998a00554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:20.726492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:20.727569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:20.728383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:43:20.734403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727362ac-bedf-4334-84c4-94f998a00554 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:20.777743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83205b-a145-452a-b8fb-b7d46baec6ba None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:20.780069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:20.815408 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb17474-1545-4ab0-9826-624c480bccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:20.816307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb17474-1545-4ab0-9826-624c480bccb0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:20.816610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb17474-1545-4ab0-9826-624c480bccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:20.816890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb17474-1545-4ab0-9826-624c480bccb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:20.819563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:20.838036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727362ac-bedf-4334-84c4-94f998a00554 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:20.874073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82de2e-3847-410d-a6b1-02762feb14c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:20.874743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82de2e-3847-410d-a6b1-02762feb14c9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:20.875038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82de2e-3847-410d-a6b1-02762feb14c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:20.875355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82de2e-3847-410d-a6b1-02762feb14c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:20.876121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82de2e-3847-410d-a6b1-02762feb14c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:20.876443 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82de2e-3847-410d-a6b1-02762feb14c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:20.877888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82de2e-3847-410d-a6b1-02762feb14c9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:20.890272 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:20.890776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb17474-1545-4ab0-9826-624c480bccb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:20.892414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb17474-1545-4ab0-9826-624c480bccb0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:20.895847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82de2e-3847-410d-a6b1-02762feb14c9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:20.998144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 15:43:21.000454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82de2e-3847-410d-a6b1-02762feb14c9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:21.004099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb17474-1545-4ab0-9826-624c480bccb0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:21.006902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:21.036243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361acd-fda4-4107-8e22-f4ea4c30fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:21.037131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361acd-fda4-4107-8e22-f4ea4c30fe1f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:21.037423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361acd-fda4-4107-8e22-f4ea4c30fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:21.037711 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361acd-fda4-4107-8e22-f4ea4c30fe1f None admin] PATH_INFO: `/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:21.038948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361acd-fda4-4107-8e22-f4ea4c30fe1f None admin] RBAC: Authorizing `identity:get_user(user_id=0a08a935c7f043a7a9ef4df0003ddf4c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:21.040463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86361acd-fda4-4107-8e22-f4ea4c30fe1f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:21.042982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:20 2022] GET /identity/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:21.048347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361acd-fda4-4107-8e22-f4ea4c30fe1f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:21.063152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:21.107420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb17474-1545-4ab0-9826-624c480bccb0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:21.141525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148a7c8-63ec-47ae-93dd-8d68352fa409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:21.142339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148a7c8-63ec-47ae-93dd-8d68352fa409 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:21.142622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148a7c8-63ec-47ae-93dd-8d68352fa409 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:21.142902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148a7c8-63ec-47ae-93dd-8d68352fa409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:21.151715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361acd-fda4-4107-8e22-f4ea4c30fe1f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:21.162704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148a7c8-63ec-47ae-93dd-8d68352fa409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:21.164242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148a7c8-63ec-47ae-93dd-8d68352fa409 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7148a7c8-63ec-47ae-93dd-8d68352fa409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:43:21.187785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:21.188636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:21.189446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:43:21.189446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:43:21.189446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:43:21.189446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:43:21.189446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:43:21.194589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148a7c8-63ec-47ae-93dd-8d68352fa409 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:21.195977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabcb02-4ae3-441b-beed-7193657dbe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:21.196790 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabcb02-4ae3-441b-beed-7193657dbe61 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:21.197082 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabcb02-4ae3-441b-beed-7193657dbe61 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:21.197545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabcb02-4ae3-441b-beed-7193657dbe61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:21.199366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabcb02-4ae3-441b-beed-7193657dbe61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:21.201017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabcb02-4ae3-441b-beed-7193657dbe61 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:21.202822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:21.208259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabcb02-4ae3-441b-beed-7193657dbe61 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:21.254019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:21.292658 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:21.299833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148a7c8-63ec-47ae-93dd-8d68352fa409 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:21.311904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabcb02-4ae3-441b-beed-7193657dbe61 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:21.333743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7887d1-3c67-4f24-a095-678d47f41adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:21.334420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7887d1-3c67-4f24-a095-678d47f41adc None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:21.334717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7887d1-3c67-4f24-a095-678d47f41adc None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:21.335001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7887d1-3c67-4f24-a095-678d47f41adc None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:21.335774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7887d1-3c67-4f24-a095-678d47f41adc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:21.336090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7887d1-3c67-4f24-a095-678d47f41adc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:21.337502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7887d1-3c67-4f24-a095-678d47f41adc None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:21.345434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89116f2b-e820-460a-8a84-e92a2fe601a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:21.346091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89116f2b-e820-460a-8a84-e92a2fe601a6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:21.346378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89116f2b-e820-460a-8a84-e92a2fe601a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:21.346657 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89116f2b-e820-460a-8a84-e92a2fe601a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:21.347529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89116f2b-e820-460a-8a84-e92a2fe601a6 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.domain.id=default, user.id=0a08a935c7f043a7a9ef4df0003ddf4c) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:21.347867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89116f2b-e820-460a-8a84-e92a2fe601a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:21.349291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89116f2b-e820-460a-8a84-e92a2fe601a6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:21.356096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:21.356228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 11/21] 10.222.0.46 () {56 vars in 1322 bytes} [Tue Jun 21 15:43:21 2022] GET /identity/v3/role_assignments?user.id=0a08a935c7f043a7a9ef4df0003ddf4c&scope.domain.id=default&role.id=29dae918965d40bea71d83ffa2085316 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:23.608571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47595bb4-3c75-45e1-898d-ebf2b97cccf9 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:23.609182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47595bb4-3c75-45e1-898d-ebf2b97cccf9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:23.609182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47595bb4-3c75-45e1-898d-ebf2b97cccf9 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:23.610880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:23.616448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2806923-2be4-49dc-9cef-a2394cb7a867 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:23.616862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2806923-2be4-49dc-9cef-a2394cb7a867 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:23.617053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2806923-2be4-49dc-9cef-a2394cb7a867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:23.644230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b2806923-2be4-49dc-9cef-a2394cb7a867 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:23.645477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2806923-2be4-49dc-9cef-a2394cb7a867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:23.737706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:23.742005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e0ea2-5919-43cd-ab3f-af95dda6d654 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:23.742305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e0ea2-5919-43cd-ab3f-af95dda6d654 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:23.742590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e0ea2-5919-43cd-ab3f-af95dda6d654 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:23.743983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:23.750135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c6f7-b107-4983-8259-af3da1b77436 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:23.750438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c6f7-b107-4983-8259-af3da1b77436 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:23.750723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c6f7-b107-4983-8259-af3da1b77436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:23.782383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c7e9c6f7-b107-4983-8259-af3da1b77436 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:23.783639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c7e9c6f7-b107-4983-8259-af3da1b77436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:23.789883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e0ea2-5919-43cd-ab3f-af95dda6d654 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:23.975276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:43:24.008683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9c6f7-b107-4983-8259-af3da1b77436 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:24.012667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:24.025954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e0ea2-5919-43cd-ab3f-af95dda6d654 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:24.067567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:24.113339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627960f8-74a2-4839-8502-70bc1e3fb0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:24.114164 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627960f8-74a2-4839-8502-70bc1e3fb0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:24.114459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627960f8-74a2-4839-8502-70bc1e3fb0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:24.114761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627960f8-74a2-4839-8502-70bc1e3fb0b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:24.145366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627960f8-74a2-4839-8502-70bc1e3fb0b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:24.146902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627960f8-74a2-4839-8502-70bc1e3fb0b3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:24.148758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9c6f7-b107-4983-8259-af3da1b77436 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-627960f8-74a2-4839-8502-70bc1e3fb0b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:43:24.180586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:24.181430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:24.182421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:43:24.182421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:43:24.182421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:43:24.182421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:43:24.184082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 13/26] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:43:24.193117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627960f8-74a2-4839-8502-70bc1e3fb0b3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:24.196880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0e3a-0d91-445d-8695-c081b2d523b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:24.197696 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0e3a-0d91-445d-8695-c081b2d523b6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:24.198022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0e3a-0d91-445d-8695-c081b2d523b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:24.198435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0e3a-0d91-445d-8695-c081b2d523b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:24.228565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e0e3a-0d91-445d-8695-c081b2d523b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-651e0e3a-0d91-445d-8695-c081b2d523b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:24.241253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:24.243334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:24.245847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 14/27] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:43:24.251537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0e3a-0d91-445d-8695-c081b2d523b6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:24.366724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:24.445949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0e3a-0d91-445d-8695-c081b2d523b6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:24.454222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627960f8-74a2-4839-8502-70bc1e3fb0b3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:24.523551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa0321-2cb5-4cf1-aa7c-82bf6e41de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:24.524237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa0321-2cb5-4cf1-aa7c-82bf6e41de13 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:24.524530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa0321-2cb5-4cf1-aa7c-82bf6e41de13 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:24.524817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa0321-2cb5-4cf1-aa7c-82bf6e41de13 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:24.525588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa0321-2cb5-4cf1-aa7c-82bf6e41de13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:24.525904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa0321-2cb5-4cf1-aa7c-82bf6e41de13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:24.527885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa0321-2cb5-4cf1-aa7c-82bf6e41de13 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:24.539769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 15/28] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:24.541081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca62d4e-8bc2-4a8a-9d21-beee17f50691 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:24.541379 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca62d4e-8bc2-4a8a-9d21-beee17f50691 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:24.541715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca62d4e-8bc2-4a8a-9d21-beee17f50691 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:24.544550 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4301a21-20fb-4138-a3e8-ea89bc15dfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:24.545226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301a21-20fb-4138-a3e8-ea89bc15dfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:24.545519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301a21-20fb-4138-a3e8-ea89bc15dfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:24.545798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301a21-20fb-4138-a3e8-ea89bc15dfb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:24.546538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4301a21-20fb-4138-a3e8-ea89bc15dfb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:24.546855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4301a21-20fb-4138-a3e8-ea89bc15dfb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:24.548295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4301a21-20fb-4138-a3e8-ea89bc15dfb7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:24.550951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 16/29] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:24.552211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca62d4e-8bc2-4a8a-9d21-beee17f50691 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:24.572300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 14/30] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:24.574339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffa5e6-7a99-448e-8895-c6ff75ca9076 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:24.574639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffa5e6-7a99-448e-8895-c6ff75ca9076 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:24.574922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffa5e6-7a99-448e-8895-c6ff75ca9076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:24.593046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-50ffa5e6-7a99-448e-8895-c6ff75ca9076 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:24.594531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-50ffa5e6-7a99-448e-8895-c6ff75ca9076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:24.627370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:24.685679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca62d4e-8bc2-4a8a-9d21-beee17f50691 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:24.696469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 15/31] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:24.698935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6143f-bc27-40ef-81d3-f3c14465e971 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:24.699265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6143f-bc27-40ef-81d3-f3c14465e971 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:24.699555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6143f-bc27-40ef-81d3-f3c14465e971 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:24.701640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 16/32] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:24.702368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6143f-bc27-40ef-81d3-f3c14465e971 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:24.729889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:24.742731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd3ef4-1235-4e2e-8500-f02495a329d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:24.743812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd3ef4-1235-4e2e-8500-f02495a329d0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:24.744248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd3ef4-1235-4e2e-8500-f02495a329d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:24.744599 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd3ef4-1235-4e2e-8500-f02495a329d0 None admin] PATH_INFO: `/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:24.746416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd3ef4-1235-4e2e-8500-f02495a329d0 None admin] RBAC: Authorizing `identity:get_user(user_id=0a08a935c7f043a7a9ef4df0003ddf4c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:24.748769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd3ef4-1235-4e2e-8500-f02495a329d0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:24.750992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 17/33] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:24 2022] GET /identity/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:24.752537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b982c59-3d8d-46a4-8abc-3c5d3fca5753 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:24.752830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b982c59-3d8d-46a4-8abc-3c5d3fca5753 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:24.753424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b982c59-3d8d-46a4-8abc-3c5d3fca5753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:24.779978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2b982c59-3d8d-46a4-8abc-3c5d3fca5753 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:24.781606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2b982c59-3d8d-46a4-8abc-3c5d3fca5753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:24.832882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6143f-bc27-40ef-81d3-f3c14465e971 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:24.861576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 18/34] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:24.868109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b982c59-3d8d-46a4-8abc-3c5d3fca5753 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:24.877102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cd229-c0f1-4520-82ea-8a115516dbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:24.878630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cd229-c0f1-4520-82ea-8a115516dbee None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:24.882031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cd229-c0f1-4520-82ea-8a115516dbee None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:24.882585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cd229-c0f1-4520-82ea-8a115516dbee None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:24.883853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cd229-c0f1-4520-82ea-8a115516dbee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:24.888705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cd229-c0f1-4520-82ea-8a115516dbee None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:25.008182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b982c59-3d8d-46a4-8abc-3c5d3fca5753 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:25.035367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:25.049102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e6b4a-4279-4a4b-a54f-2f9deeaa4f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:25.050054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e6b4a-4279-4a4b-a54f-2f9deeaa4f15 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:25.050479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e6b4a-4279-4a4b-a54f-2f9deeaa4f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:25.050894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e6b4a-4279-4a4b-a54f-2f9deeaa4f15 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:25.051835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e6b4a-4279-4a4b-a54f-2f9deeaa4f15 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:25.053670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e6b4a-4279-4a4b-a54f-2f9deeaa4f15 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:25.085418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 17/35] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:43:24 2022] POST /identity/v3/projects => generated 301 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:43:25.086951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cd229-c0f1-4520-82ea-8a115516dbee None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:25.102958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:25.200500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 19/36] 10.222.0.46 () {60 vars in 1131 bytes} [Tue Jun 21 15:43:24 2022] POST /identity/v3/roles => generated 225 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:43:25.201570 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e6b4a-4279-4a4b-a54f-2f9deeaa4f15 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:25.223056 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cd229-c0f1-4520-82ea-8a115516dbee None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:25.272262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60353ff-21cd-4380-9fdd-993a79417046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:25.273021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60353ff-21cd-4380-9fdd-993a79417046 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:25.273313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60353ff-21cd-4380-9fdd-993a79417046 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:25.273596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60353ff-21cd-4380-9fdd-993a79417046 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:25.275325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60353ff-21cd-4380-9fdd-993a79417046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:25.277850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60353ff-21cd-4380-9fdd-993a79417046 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:25.280435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 18/37] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:25.288426 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60353ff-21cd-4380-9fdd-993a79417046 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:25.442529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e6b4a-4279-4a4b-a54f-2f9deeaa4f15 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:25.447126 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:25.486411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60353ff-21cd-4380-9fdd-993a79417046 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:25.500085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6869e3-1eb1-4ed7-83ae-333fa44ddf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:25.500745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6869e3-1eb1-4ed7-83ae-333fa44ddf2c None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:25.501045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6869e3-1eb1-4ed7-83ae-333fa44ddf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:25.501336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6869e3-1eb1-4ed7-83ae-333fa44ddf2c None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:25.502112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6869e3-1eb1-4ed7-83ae-333fa44ddf2c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:25.503697 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6869e3-1eb1-4ed7-83ae-333fa44ddf2c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:25.521544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 20/38] 10.222.0.46 () {60 vars in 1131 bytes} [Tue Jun 21 15:43:25 2022] POST /identity/v3/roles => generated 219 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:43:25.523350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f842-fcc5-41ec-9c88-0bd71858c727 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:25.523596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f842-fcc5-41ec-9c88-0bd71858c727 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:25.523882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f842-fcc5-41ec-9c88-0bd71858c727 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:25.525278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 21/39] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:25.526520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1820-4f65-407f-a43f-7db54ddc47bc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:25.526816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1820-4f65-407f-a43f-7db54ddc47bc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:25.527224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1820-4f65-407f-a43f-7db54ddc47bc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:25.528811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 22/40] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:25.534196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493422a-3b3d-4bfd-91e7-ebe57f629ff6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:25.534402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493422a-3b3d-4bfd-91e7-ebe57f629ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:25.534647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493422a-3b3d-4bfd-91e7-ebe57f629ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:25.536047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9653da5-3ca6-4bd3-8a5c-308db3746dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:25.536956 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9653da5-3ca6-4bd3-8a5c-308db3746dcb None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:25.537265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9653da5-3ca6-4bd3-8a5c-308db3746dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:25.537532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9653da5-3ca6-4bd3-8a5c-308db3746dcb None admin] PATH_INFO: `/v3/domains/default/users/0a08a935c7f043a7a9ef4df0003ddf4c/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:25.540107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9653da5-3ca6-4bd3-8a5c-308db3746dcb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0a08a935c7f043a7a9ef4df0003ddf4c, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:25.542137 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9653da5-3ca6-4bd3-8a5c-308db3746dcb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:25.554474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7493422a-3b3d-4bfd-91e7-ebe57f629ff6 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:25.556141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7493422a-3b3d-4bfd-91e7-ebe57f629ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:25.560166 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 19/41] 10.222.0.46 () {58 vars in 1361 bytes} [Tue Jun 21 15:43:25 2022] PUT /identity/v3/domains/default/users/0a08a935c7f043a7a9ef4df0003ddf4c/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:43:25.561672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5a8e-b90e-4b87-b4e0-c642304830ec None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:25.561970 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5a8e-b90e-4b87-b4e0-c642304830ec None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:25.562258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5a8e-b90e-4b87-b4e0-c642304830ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:25.583748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c86e5a8e-b90e-4b87-b4e0-c642304830ec None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:25.585514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c86e5a8e-b90e-4b87-b4e0-c642304830ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:25.626980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:25.675805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 23/42] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:25.678483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 20/43] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:25.693441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493422a-3b3d-4bfd-91e7-ebe57f629ff6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:25.702596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5a8e-b90e-4b87-b4e0-c642304830ec None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:25.792338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:25.837876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5a8e-b90e-4b87-b4e0-c642304830ec None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:25.878960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841f537-0e99-40a7-8c0e-85dfa8054fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:25.879859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841f537-0e99-40a7-8c0e-85dfa8054fa8 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:25.880230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841f537-0e99-40a7-8c0e-85dfa8054fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:25.880645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841f537-0e99-40a7-8c0e-85dfa8054fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:25.881530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841f537-0e99-40a7-8c0e-85dfa8054fa8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:25.883262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841f537-0e99-40a7-8c0e-85dfa8054fa8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:25.900703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 21/44] 10.222.0.46 () {60 vars in 1131 bytes} [Tue Jun 21 15:43:25 2022] POST /identity/v3/roles => generated 223 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:43:25.940225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493422a-3b3d-4bfd-91e7-ebe57f629ff6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:25.981836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c20343-e399-4bf3-be0a-d3ca44a8b273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:25.982669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c20343-e399-4bf3-be0a-d3ca44a8b273 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:25.982960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c20343-e399-4bf3-be0a-d3ca44a8b273 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:25.983274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c20343-e399-4bf3-be0a-d3ca44a8b273 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:25.984572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c20343-e399-4bf3-be0a-d3ca44a8b273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:25.986101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c20343-e399-4bf3-be0a-d3ca44a8b273 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:25.987911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 24/45] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:25.994080 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841f537-0e99-40a7-8c0e-85dfa8054fa8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:26.109390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841f537-0e99-40a7-8c0e-85dfa8054fa8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:26.137656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:26.147333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe46cc-7281-477d-b425-17e270a1c5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:26.148026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe46cc-7281-477d-b425-17e270a1c5d0 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:26.148315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe46cc-7281-477d-b425-17e270a1c5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:26.148596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe46cc-7281-477d-b425-17e270a1c5d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:26.149311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe46cc-7281-477d-b425-17e270a1c5d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:26.150772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe46cc-7281-477d-b425-17e270a1c5d0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:26.176196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 22/46] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:43:25 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:43:27.640642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915ec14-fdd0-4ea3-9358-1254a19dcb63 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:27.641169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915ec14-fdd0-4ea3-9358-1254a19dcb63 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:27.641252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915ec14-fdd0-4ea3-9358-1254a19dcb63 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:27.642577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 25/47] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:27.648092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9d94-5c9e-487a-9d10-8bcc7a5d4131 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:27.648784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9d94-5c9e-487a-9d10-8bcc7a5d4131 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:27.649111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9d94-5c9e-487a-9d10-8bcc7a5d4131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:27.666378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-430a9d94-5c9e-487a-9d10-8bcc7a5d4131 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:27.668323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-430a9d94-5c9e-487a-9d10-8bcc7a5d4131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:27.735549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 23/48] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:27.759259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915ec14-fdd0-4ea3-9358-1254a19dcb63 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:27.804689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:27.866347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915ec14-fdd0-4ea3-9358-1254a19dcb63 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:27.903325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb63ff-3353-4e7c-a749-9b2058b71116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:27.904334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb63ff-3353-4e7c-a749-9b2058b71116 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:27.904636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb63ff-3353-4e7c-a749-9b2058b71116 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:27.904924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb63ff-3353-4e7c-a749-9b2058b71116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:27.915431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb63ff-3353-4e7c-a749-9b2058b71116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8dbb63ff-3353-4e7c-a749-9b2058b71116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:27.923887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:27.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:27.925521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:27.927478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 26/49] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:43:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:27.932329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a9d94-5c9e-487a-9d10-8bcc7a5d4131 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:28.034965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a9d94-5c9e-487a-9d10-8bcc7a5d4131 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:28.046102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:28.070725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd468b-dfa8-485e-9b05-2b2fc60ced5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:28.071433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd468b-dfa8-485e-9b05-2b2fc60ced5f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:28.071729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd468b-dfa8-485e-9b05-2b2fc60ced5f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:28.072038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd468b-dfa8-485e-9b05-2b2fc60ced5f None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:28.073304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd468b-dfa8-485e-9b05-2b2fc60ced5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:28.073928 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd468b-dfa8-485e-9b05-2b2fc60ced5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:28.075071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd468b-dfa8-485e-9b05-2b2fc60ced5f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:28.094434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 24/50] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:28.095704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb63ff-3353-4e7c-a749-9b2058b71116 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:28.198489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb63ff-3353-4e7c-a749-9b2058b71116 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:28.200284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:28.222686 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b3b1-320c-4440-95a8-9843c1d837ce None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:28.223322 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b3b1-320c-4440-95a8-9843c1d837ce None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:28.223829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b3b1-320c-4440-95a8-9843c1d837ce None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:28.225788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 25/51] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:43:28.231129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457cee0-6c40-4f68-ab79-2da068360109 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:28.231528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457cee0-6c40-4f68-ab79-2da068360109 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:28.231941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457cee0-6c40-4f68-ab79-2da068360109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:28.238501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c397f-79e7-4d66-baab-678c965a2fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:28.239431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c397f-79e7-4d66-baab-678c965a2fca None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:28.239725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c397f-79e7-4d66-baab-678c965a2fca None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:28.240015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c397f-79e7-4d66-baab-678c965a2fca None admin] PATH_INFO: `/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:28.241241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c397f-79e7-4d66-baab-678c965a2fca None admin] RBAC: Authorizing `identity:get_user(user_id=0a08a935c7f043a7a9ef4df0003ddf4c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:28.242725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c397f-79e7-4d66-baab-678c965a2fca None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:28.244454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 27/52] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:28 2022] GET /identity/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:28.250396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c397f-79e7-4d66-baab-678c965a2fca None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:28.250558 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b457cee0-6c40-4f68-ab79-2da068360109 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:28.251736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b457cee0-6c40-4f68-ab79-2da068360109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:28.359953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c397f-79e7-4d66-baab-678c965a2fca None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:28.397461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20122826-81c2-4c53-803b-41557d3b7976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:28.398261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20122826-81c2-4c53-803b-41557d3b7976 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:28.398549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20122826-81c2-4c53-803b-41557d3b7976 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:28.398826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20122826-81c2-4c53-803b-41557d3b7976 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:28.400063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20122826-81c2-4c53-803b-41557d3b7976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:28.401703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20122826-81c2-4c53-803b-41557d3b7976 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:28.403556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 28/53] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:28.409062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20122826-81c2-4c53-803b-41557d3b7976 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:28.430158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 26/54] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:43:28.451028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:28.456623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457cee0-6c40-4f68-ab79-2da068360109 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:28.517028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20122826-81c2-4c53-803b-41557d3b7976 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:28.553486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24c58a-a546-48f2-892f-e4419b70de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:28.554147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24c58a-a546-48f2-892f-e4419b70de3e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:28.554443 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24c58a-a546-48f2-892f-e4419b70de3e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:28.554734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24c58a-a546-48f2-892f-e4419b70de3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:28.555619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24c58a-a546-48f2-892f-e4419b70de3e None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.domain.id=default, user.id=0a08a935c7f043a7a9ef4df0003ddf4c) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:28.555942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24c58a-a546-48f2-892f-e4419b70de3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:28.557950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24c58a-a546-48f2-892f-e4419b70de3e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:28.564000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 29/55] 10.222.0.46 () {56 vars in 1322 bytes} [Tue Jun 21 15:43:28 2022] GET /identity/v3/role_assignments?user.id=0a08a935c7f043a7a9ef4df0003ddf4c&scope.domain.id=default&role.id=29dae918965d40bea71d83ffa2085316 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:28.566415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457cee0-6c40-4f68-ab79-2da068360109 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:28.568065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:28.611516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11513e0-2586-4f18-9466-88906ff15b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:28.612348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11513e0-2586-4f18-9466-88906ff15b62 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:28.612634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11513e0-2586-4f18-9466-88906ff15b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:28.612914 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11513e0-2586-4f18-9466-88906ff15b62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:28.614220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11513e0-2586-4f18-9466-88906ff15b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:28.615855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11513e0-2586-4f18-9466-88906ff15b62 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:28.617683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 27/56] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:28.624740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24c58a-a546-48f2-892f-e4419b70de3e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:28.737002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24c58a-a546-48f2-892f-e4419b70de3e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:28.738498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:28.775733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b167ee-50d0-4ed2-9027-2897b0458375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:28.776412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b167ee-50d0-4ed2-9027-2897b0458375 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:28.776730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b167ee-50d0-4ed2-9027-2897b0458375 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:28.776990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b167ee-50d0-4ed2-9027-2897b0458375 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:28.777712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b167ee-50d0-4ed2-9027-2897b0458375 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:28.779257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b167ee-50d0-4ed2-9027-2897b0458375 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:28.806633 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 30/57] 10.222.0.46 () {60 vars in 1140 bytes} [Tue Jun 21 15:43:28 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:43:30.904237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5e57-6e15-4394-bcdf-bb142b5b1ea5 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:30.904823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5e57-6e15-4394-bcdf-bb142b5b1ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:30.904823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5e57-6e15-4394-bcdf-bb142b5b1ea5 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:30.906183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 28/58] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:30.911446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bb01d-4482-4027-9130-703f17b14182 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:30.911814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bb01d-4482-4027-9130-703f17b14182 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:30.912019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bb01d-4482-4027-9130-703f17b14182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:30.929104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ac2bb01d-4482-4027-9130-703f17b14182 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:30.930712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ac2bb01d-4482-4027-9130-703f17b14182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:30.997909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 31/59] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:31.022880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef5e57-6e15-4394-bcdf-bb142b5b1ea5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:31.122923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef5e57-6e15-4394-bcdf-bb142b5b1ea5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:31.154933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd54f1-d214-449f-bc3a-155f23e23bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:31.155690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd54f1-d214-449f-bc3a-155f23e23bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:31.155976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd54f1-d214-449f-bc3a-155f23e23bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:31.156252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd54f1-d214-449f-bc3a-155f23e23bf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:31.157420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd54f1-d214-449f-bc3a-155f23e23bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:31.158861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd54f1-d214-449f-bc3a-155f23e23bf4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:31.160501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 29/60] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:31.166100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bb01d-4482-4027-9130-703f17b14182 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:31.248511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:31.265756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bb01d-4482-4027-9130-703f17b14182 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:31.302799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09abb47-68dc-4380-a471-2cfcb9d334e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:31.303506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abb47-68dc-4380-a471-2cfcb9d334e7 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:31.303808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abb47-68dc-4380-a471-2cfcb9d334e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:31.304095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abb47-68dc-4380-a471-2cfcb9d334e7 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:31.304823 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09abb47-68dc-4380-a471-2cfcb9d334e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:31.306294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09abb47-68dc-4380-a471-2cfcb9d334e7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:31.331028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 32/61] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:43:31 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:43:34.643427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e46e37-c176-46fb-b7be-d48a99b224c7 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:34.644459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e46e37-c176-46fb-b7be-d48a99b224c7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:34.644977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e46e37-c176-46fb-b7be-d48a99b224c7 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:34.646857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 30/62] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:34.661411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52120c3-f476-4c9e-a689-bb54446aacbb None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:34.662035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52120c3-f476-4c9e-a689-bb54446aacbb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:34.662524 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52120c3-f476-4c9e-a689-bb54446aacbb None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:34.664213 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:43:34.665829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88547c96-a2c9-4eae-b77a-5d7c5b5241b1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:34.667479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88547c96-a2c9-4eae-b77a-5d7c5b5241b1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:34.668016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88547c96-a2c9-4eae-b77a-5d7c5b5241b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:34.670447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3af73-d7da-4d32-b50c-989cdd1d9871 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:34.670985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3af73-d7da-4d32-b50c-989cdd1d9871 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:34.671486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3af73-d7da-4d32-b50c-989cdd1d9871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:34.703330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3ab3af73-d7da-4d32-b50c-989cdd1d9871 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:34.704917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3ab3af73-d7da-4d32-b50c-989cdd1d9871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:34.706047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-88547c96-a2c9-4eae-b77a-5d7c5b5241b1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:34.707466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-88547c96-a2c9-4eae-b77a-5d7c5b5241b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:34.778393 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:34.827461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 33/64] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:34.849388 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 32/65] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:43:34.860653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88547c96-a2c9-4eae-b77a-5d7c5b5241b1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:34.876599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3af73-d7da-4d32-b50c-989cdd1d9871 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:35.002963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:35.029188 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3af73-d7da-4d32-b50c-989cdd1d9871 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:35.041154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88547c96-a2c9-4eae-b77a-5d7c5b5241b1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:35.069860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1e69d-b7e8-4e0f-8ca1-a63979aebfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:35.070971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1e69d-b7e8-4e0f-8ca1-a63979aebfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.071295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1e69d-b7e8-4e0f-8ca1-a63979aebfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.071580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1e69d-b7e8-4e0f-8ca1-a63979aebfb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.078979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20563e49-ee7f-4d38-862d-e91c5f6569c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:35.079844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20563e49-ee7f-4d38-862d-e91c5f6569c9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.080136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20563e49-ee7f-4d38-862d-e91c5f6569c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.080416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20563e49-ee7f-4d38-862d-e91c5f6569c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.084542 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1e69d-b7e8-4e0f-8ca1-a63979aebfb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:35.092917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20563e49-ee7f-4d38-862d-e91c5f6569c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-afb1e69d-b7e8-4e0f-8ca1-a63979aebfb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:35.093784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:35.094605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:43:35.095825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 33/66] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:35.096698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dd3f2-e8f6-4c02-ae6c-3a5affa6042c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.096698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dd3f2-e8f6-4c02-ae6c-3a5affa6042c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.096963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dd3f2-e8f6-4c02-ae6c-3a5affa6042c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.098295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 34/67] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-20563e49-ee7f-4d38-862d-e91c5f6569c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:35.100960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:35.101797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:35.102559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:35.103135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d37c8-a7f5-48c8-bb03-18dd90e831d7 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.103392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d37c8-a7f5-48c8-bb03-18dd90e831d7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.103685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d37c8-a7f5-48c8-bb03-18dd90e831d7 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.105133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 35/68] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:35.105700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d37c8-a7f5-48c8-bb03-18dd90e831d7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:35.109129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:43:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:35.110498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d37cf-1768-464c-b469-c7a5bf4b0ac9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.110797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d37cf-1768-464c-b469-c7a5bf4b0ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.111084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d37cf-1768-464c-b469-c7a5bf4b0ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.134574 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ae7d37cf-1768-464c-b469-c7a5bf4b0ac9 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:35.136435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ae7d37cf-1768-464c-b469-c7a5bf4b0ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:35.136587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:35.206188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 35/70] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:35.207513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a74126-6e38-4f61-839f-3009230e6334 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.207813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a74126-6e38-4f61-839f-3009230e6334 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.208102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a74126-6e38-4f61-839f-3009230e6334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.226452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d37c8-a7f5-48c8-bb03-18dd90e831d7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:35.226642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b8a74126-6e38-4f61-839f-3009230e6334 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:35.228013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b8a74126-6e38-4f61-839f-3009230e6334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:35.273930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2bf03-ba5e-42d2-b0dd-e7b37454d474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:35.274608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2bf03-ba5e-42d2-b0dd-e7b37454d474 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.274911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2bf03-ba5e-42d2-b0dd-e7b37454d474 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.275225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2bf03-ba5e-42d2-b0dd-e7b37454d474 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.276151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2bf03-ba5e-42d2-b0dd-e7b37454d474 None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:35.276497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2bf03-ba5e-42d2-b0dd-e7b37454d474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:35.277902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2bf03-ba5e-42d2-b0dd-e7b37454d474 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:35.286810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 36/71] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:35.287666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2bf03-ba5e-42d2-b0dd-e7b37454d474 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:35.292751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:35.304933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 36/72] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:35.306338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba96da-cad4-41a4-8be0-9cbc879e4431 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.306669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba96da-cad4-41a4-8be0-9cbc879e4431 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.307521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba96da-cad4-41a4-8be0-9cbc879e4431 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.308980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 37/73] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:35.313737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba96da-cad4-41a4-8be0-9cbc879e4431 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:35.382022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:35.399938 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2bf03-ba5e-42d2-b0dd-e7b37454d474 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:35.429714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba96da-cad4-41a4-8be0-9cbc879e4431 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:35.439503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a105573-2e07-4f9e-9804-13cc7a26addb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:35.440360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a105573-2e07-4f9e-9804-13cc7a26addb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.440622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a105573-2e07-4f9e-9804-13cc7a26addb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.440924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a105573-2e07-4f9e-9804-13cc7a26addb None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.441579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a105573-2e07-4f9e-9804-13cc7a26addb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:35.441896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a105573-2e07-4f9e-9804-13cc7a26addb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:35.443370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a105573-2e07-4f9e-9804-13cc7a26addb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:35.454334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 37/74] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:35.454334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a105573-2e07-4f9e-9804-13cc7a26addb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:35.468886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e1ec8-ba73-4966-814c-569c4a56a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:35.469626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1ec8-ba73-4966-814c-569c4a56a292 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.469916 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1ec8-ba73-4966-814c-569c4a56a292 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.470180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1ec8-ba73-4966-814c-569c4a56a292 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.481579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e1ec8-ba73-4966-814c-569c4a56a292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0a9e1ec8-ba73-4966-814c-569c4a56a292 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:35.489935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:35.490968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:35.491758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 38/75] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:43:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:35.492586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088b73d-5116-436b-982b-332293572463 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.492828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088b73d-5116-436b-982b-332293572463 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.493108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088b73d-5116-436b-982b-332293572463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.510590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c088b73d-5116-436b-982b-332293572463 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:35.513182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c088b73d-5116-436b-982b-332293572463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:35.561934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:35.571849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a105573-2e07-4f9e-9804-13cc7a26addb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:35.587945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 39/76] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:35.589475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088b73d-5116-436b-982b-332293572463 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:35.614421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775eb529-18ac-48f9-89b3-dd1603e3d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:35.615348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eb529-18ac-48f9-89b3-dd1603e3d786 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.615651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eb529-18ac-48f9-89b3-dd1603e3d786 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.615927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eb529-18ac-48f9-89b3-dd1603e3d786 None admin] PATH_INFO: `/v3/users/e87267a1a91149ffb8c5db7e4c35a24c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.632755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775eb529-18ac-48f9-89b3-dd1603e3d786 None admin] RBAC: Authorizing `identity:get_user(user_id=e87267a1a91149ffb8c5db7e4c35a24c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:35.634594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775eb529-18ac-48f9-89b3-dd1603e3d786 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:35.637037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 38/77] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:35 2022] GET /identity/v3/users/e87267a1a91149ffb8c5db7e4c35a24c => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:35.638150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775eb529-18ac-48f9-89b3-dd1603e3d786 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:35.654108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:35.697429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088b73d-5116-436b-982b-332293572463 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:35.732678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe8f0-0364-4488-9eca-00e6eaa7d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:35.733400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe8f0-0364-4488-9eca-00e6eaa7d83b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.733696 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe8f0-0364-4488-9eca-00e6eaa7d83b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.733984 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efe8f0-0364-4488-9eca-00e6eaa7d83b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.745999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775eb529-18ac-48f9-89b3-dd1603e3d786 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:35.750216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efe8f0-0364-4488-9eca-00e6eaa7d83b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-10efe8f0-0364-4488-9eca-00e6eaa7d83b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:35.758094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:35.758973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:35.759913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 40/78] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:35.761126 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe8f0-0364-4488-9eca-00e6eaa7d83b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:35.785991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76801dc0-a8cd-406c-bdc3-90e75e0c0aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:35.786877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76801dc0-a8cd-406c-bdc3-90e75e0c0aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.787185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76801dc0-a8cd-406c-bdc3-90e75e0c0aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.787485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76801dc0-a8cd-406c-bdc3-90e75e0c0aa2 None admin] PATH_INFO: `/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.788709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76801dc0-a8cd-406c-bdc3-90e75e0c0aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=0a08a935c7f043a7a9ef4df0003ddf4c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:35.790185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76801dc0-a8cd-406c-bdc3-90e75e0c0aa2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:35.791962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 39/79] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:35 2022] GET /identity/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:35.796552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76801dc0-a8cd-406c-bdc3-90e75e0c0aa2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:35.806749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:35.868604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efe8f0-0364-4488-9eca-00e6eaa7d83b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:35.876326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:35.899633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76801dc0-a8cd-406c-bdc3-90e75e0c0aa2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:35.904290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791471e5-5137-4bc6-a5c9-455923f3a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:35.904970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791471e5-5137-4bc6-a5c9-455923f3a796 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.905262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791471e5-5137-4bc6-a5c9-455923f3a796 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.905551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791471e5-5137-4bc6-a5c9-455923f3a796 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.906317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791471e5-5137-4bc6-a5c9-455923f3a796 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:35.906634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791471e5-5137-4bc6-a5c9-455923f3a796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:35.908082 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791471e5-5137-4bc6-a5c9-455923f3a796 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:35.916374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 41/80] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:43:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:35.921163 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791471e5-5137-4bc6-a5c9-455923f3a796 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:35.938762 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a15ba1-a33b-4cb5-aaf7-bd58312d4b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:35.939606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a15ba1-a33b-4cb5-aaf7-bd58312d4b44 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:35.939896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a15ba1-a33b-4cb5-aaf7-bd58312d4b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:35.940176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a15ba1-a33b-4cb5-aaf7-bd58312d4b44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:35.941356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a15ba1-a33b-4cb5-aaf7-bd58312d4b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:35.942821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a15ba1-a33b-4cb5-aaf7-bd58312d4b44 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:35.944594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 40/81] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:35.945363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a15ba1-a33b-4cb5-aaf7-bd58312d4b44 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:36.024303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791471e5-5137-4bc6-a5c9-455923f3a796 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:36.026260 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:36.052018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a15ba1-a33b-4cb5-aaf7-bd58312d4b44 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:36.060330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1818c-225c-41bb-a6d2-80427ac6a004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:36.060995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1818c-225c-41bb-a6d2-80427ac6a004 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:36.061292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1818c-225c-41bb-a6d2-80427ac6a004 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:36.061589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1818c-225c-41bb-a6d2-80427ac6a004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:36.086574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82af06-9700-40d3-a3b2-0d395883668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:36.087315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82af06-9700-40d3-a3b2-0d395883668f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:36.087608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82af06-9700-40d3-a3b2-0d395883668f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:36.087893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82af06-9700-40d3-a3b2-0d395883668f None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:36.088666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82af06-9700-40d3-a3b2-0d395883668f None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:36.088993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82af06-9700-40d3-a3b2-0d395883668f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:36.090395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82af06-9700-40d3-a3b2-0d395883668f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:36.098549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 41/82] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:36.099565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82af06-9700-40d3-a3b2-0d395883668f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:36.110705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:36.133120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1818c-225c-41bb-a6d2-80427ac6a004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:36.134602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1818c-225c-41bb-a6d2-80427ac6a004 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:36.204470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82af06-9700-40d3-a3b2-0d395883668f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:36.237347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 42/83] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:36.237935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1818c-225c-41bb-a6d2-80427ac6a004 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:36.240194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:36.243259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39a6c6-ed4b-4faf-bfbe-57030218689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:36.243997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39a6c6-ed4b-4faf-bfbe-57030218689c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:36.244293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39a6c6-ed4b-4faf-bfbe-57030218689c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:36.244605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39a6c6-ed4b-4faf-bfbe-57030218689c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:36.314750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39a6c6-ed4b-4faf-bfbe-57030218689c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:36.316195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39a6c6-ed4b-4faf-bfbe-57030218689c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:36.326363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:36.339635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1818c-225c-41bb-a6d2-80427ac6a004 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:36.384799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b5cc-c840-4fb7-9fd4-95a1f32da8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:36.386741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b5cc-c840-4fb7-9fd4-95a1f32da8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:36.387259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b5cc-c840-4fb7-9fd4-95a1f32da8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:36.387752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b5cc-c840-4fb7-9fd4-95a1f32da8b4 None admin] PATH_INFO: `/v3/users/e87267a1a91149ffb8c5db7e4c35a24c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:36.390243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b5cc-c840-4fb7-9fd4-95a1f32da8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=e87267a1a91149ffb8c5db7e4c35a24c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:36.391576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b5cc-c840-4fb7-9fd4-95a1f32da8b4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:36.393521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 43/84] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:36 2022] GET /identity/v3/users/e87267a1a91149ffb8c5db7e4c35a24c => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:36.394071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b5cc-c840-4fb7-9fd4-95a1f32da8b4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:36.429119 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 42/85] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:36.429978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39a6c6-ed4b-4faf-bfbe-57030218689c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:36.469547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:36.501083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b5cc-c840-4fb7-9fd4-95a1f32da8b4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:36.533414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39a6c6-ed4b-4faf-bfbe-57030218689c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:36.536067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a8e78-be71-4438-b407-7684ffc386ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:36.536746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8e78-be71-4438-b407-7684ffc386ec None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:36.537038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8e78-be71-4438-b407-7684ffc386ec None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:36.537329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8e78-be71-4438-b407-7684ffc386ec None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:36.538058 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a8e78-be71-4438-b407-7684ffc386ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:36.539557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a8e78-be71-4438-b407-7684ffc386ec None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:36.543131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:36.559385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 44/86] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:43:36 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:43:36.560228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a8e78-be71-4438-b407-7684ffc386ec None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:36.580295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcded17-07dd-47dd-ad7d-c8391b31283e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:36.581120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcded17-07dd-47dd-ad7d-c8391b31283e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:36.581404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcded17-07dd-47dd-ad7d-c8391b31283e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:36.581685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcded17-07dd-47dd-ad7d-c8391b31283e None admin] PATH_INFO: `/v3/users/e87267a1a91149ffb8c5db7e4c35a24c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:36.583361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcded17-07dd-47dd-ad7d-c8391b31283e None admin] RBAC: Authorizing `identity:get_user(user_id=e87267a1a91149ffb8c5db7e4c35a24c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:36.584559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcded17-07dd-47dd-ad7d-c8391b31283e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:36.586522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 43/87] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:36 2022] GET /identity/v3/users/e87267a1a91149ffb8c5db7e4c35a24c => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:36.587272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcded17-07dd-47dd-ad7d-c8391b31283e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:36.699887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a8e78-be71-4438-b407-7684ffc386ec None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:36.708657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcded17-07dd-47dd-ad7d-c8391b31283e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:36.731560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:36.743065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8bcfe-1f05-4b9a-8484-70bfe5d4c6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:36.744849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bcfe-1f05-4b9a-8484-70bfe5d4c6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:36.745412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bcfe-1f05-4b9a-8484-70bfe5d4c6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:36.745844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bcfe-1f05-4b9a-8484-70bfe5d4c6a7 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:36.747116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8bcfe-1f05-4b9a-8484-70bfe5d4c6a7 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:36.748655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8bcfe-1f05-4b9a-8484-70bfe5d4c6a7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:36.750494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 45/88] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:36 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:36.751406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8bcfe-1f05-4b9a-8484-70bfe5d4c6a7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:36.752762 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0e50a-625c-4c0c-b009-43ddc79ae176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:36.753422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e50a-625c-4c0c-b009-43ddc79ae176 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:36.753721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e50a-625c-4c0c-b009-43ddc79ae176 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:36.754006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e50a-625c-4c0c-b009-43ddc79ae176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:36.814605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:36.847734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0e50a-625c-4c0c-b009-43ddc79ae176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:36.849146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0e50a-625c-4c0c-b009-43ddc79ae176 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:36.894496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8bcfe-1f05-4b9a-8484-70bfe5d4c6a7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:36.935662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5714ec-8251-4bdd-806d-a3074607bd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:36.936654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5714ec-8251-4bdd-806d-a3074607bd4d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:36.936948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5714ec-8251-4bdd-806d-a3074607bd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:36.937569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5714ec-8251-4bdd-806d-a3074607bd4d None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:36.938448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5714ec-8251-4bdd-806d-a3074607bd4d None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:36.940060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5714ec-8251-4bdd-806d-a3074607bd4d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:36.942064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 46/89] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:36 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:36.947412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5714ec-8251-4bdd-806d-a3074607bd4d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:36.977743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 44/90] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:36.978617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0e50a-625c-4c0c-b009-43ddc79ae176 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:37.017343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:37.060869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5714ec-8251-4bdd-806d-a3074607bd4d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:37.065968 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:37.095141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0e50a-625c-4c0c-b009-43ddc79ae176 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:37.106861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f063171-411c-4771-bac0-3a17b7303339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:37.107484 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f063171-411c-4771-bac0-3a17b7303339 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:37.107826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f063171-411c-4771-bac0-3a17b7303339 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:37.108585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f063171-411c-4771-bac0-3a17b7303339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:37.140813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9ea48-d43c-499a-bd1b-d0c34aa9d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:37.141525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9ea48-d43c-499a-bd1b-d0c34aa9d237 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:37.141766 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9ea48-d43c-499a-bd1b-d0c34aa9d237 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:37.142046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9ea48-d43c-499a-bd1b-d0c34aa9d237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:37.142888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9ea48-d43c-499a-bd1b-d0c34aa9d237 None admin] RBAC: Adding query filter params (role.id=c78e303f11a84bcd80e78de27d7d26f2, scope.project.id=21ac6b9f65304534adce7421674442c6, user.id=e87267a1a91149ffb8c5db7e4c35a24c) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:37.143237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9ea48-d43c-499a-bd1b-d0c34aa9d237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:37.144781 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9ea48-d43c-499a-bd1b-d0c34aa9d237 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:37.154288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 45/91] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:36 2022] GET /identity/v3/role_assignments?user.id=e87267a1a91149ffb8c5db7e4c35a24c&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:37.155317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9ea48-d43c-499a-bd1b-d0c34aa9d237 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:37.212112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f063171-411c-4771-bac0-3a17b7303339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:37.215017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f063171-411c-4771-bac0-3a17b7303339 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:37.285355 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9ea48-d43c-499a-bd1b-d0c34aa9d237 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:37.299369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:37.350989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 47/92] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:37.352358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f063171-411c-4771-bac0-3a17b7303339 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:37.411377 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76787-1266-41b0-bf88-319199566404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:37.412063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76787-1266-41b0-bf88-319199566404 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:37.412355 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76787-1266-41b0-bf88-319199566404 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:37.412638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76787-1266-41b0-bf88-319199566404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:37.413494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced76787-1266-41b0-bf88-319199566404 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=21ac6b9f65304534adce7421674442c6, user.id=0a08a935c7f043a7a9ef4df0003ddf4c) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:37.413815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced76787-1266-41b0-bf88-319199566404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:37.415300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced76787-1266-41b0-bf88-319199566404 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:37.431478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 46/93] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:37 2022] GET /identity/v3/role_assignments?user.id=0a08a935c7f043a7a9ef4df0003ddf4c&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=29dae918965d40bea71d83ffa2085316 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:37.433085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76787-1266-41b0-bf88-319199566404 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:37.441128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:37.481621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f063171-411c-4771-bac0-3a17b7303339 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:37.527717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b25b4-c206-47b2-99c0-17d3d132588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:37.528970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b25b4-c206-47b2-99c0-17d3d132588d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:37.529486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b25b4-c206-47b2-99c0-17d3d132588d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:37.529964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b25b4-c206-47b2-99c0-17d3d132588d None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:37.531584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b25b4-c206-47b2-99c0-17d3d132588d None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:37.533937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b25b4-c206-47b2-99c0-17d3d132588d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:37.536287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 48/94] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:37 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:37.543294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b25b4-c206-47b2-99c0-17d3d132588d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:37.593244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:37.687277 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76787-1266-41b0-bf88-319199566404 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:37.716668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b25b4-c206-47b2-99c0-17d3d132588d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:37.747913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774f32-b63d-47e9-b10e-e42f1baa6bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:37.748848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774f32-b63d-47e9-b10e-e42f1baa6bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:37.749083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774f32-b63d-47e9-b10e-e42f1baa6bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:37.749368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774f32-b63d-47e9-b10e-e42f1baa6bc1 None admin] PATH_INFO: `/v3/projects/81153851a37d4d1bb980a6b4efce47fa` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:37.750615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774f32-b63d-47e9-b10e-e42f1baa6bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=81153851a37d4d1bb980a6b4efce47fa)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:37.752169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774f32-b63d-47e9-b10e-e42f1baa6bc1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:37.753939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 47/95] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:37 2022] GET /identity/v3/projects/81153851a37d4d1bb980a6b4efce47fa => generated 312 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:37.763208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774f32-b63d-47e9-b10e-e42f1baa6bc1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:37.792948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcdf27-94eb-4aa7-a0c7-b992eaf1a131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:37.793641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcdf27-94eb-4aa7-a0c7-b992eaf1a131 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:37.793929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcdf27-94eb-4aa7-a0c7-b992eaf1a131 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:37.794210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcdf27-94eb-4aa7-a0c7-b992eaf1a131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:37.795071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcdf27-94eb-4aa7-a0c7-b992eaf1a131 None admin] RBAC: Adding query filter params (role.id=8bd0b3ec424b423da0670486cc02bc49, scope.project.id=21ac6b9f65304534adce7421674442c6, user.id=e87267a1a91149ffb8c5db7e4c35a24c) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:37.795422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcdf27-94eb-4aa7-a0c7-b992eaf1a131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:37.796935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcdf27-94eb-4aa7-a0c7-b992eaf1a131 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:37.813675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 49/96] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:37 2022] GET /identity/v3/role_assignments?user.id=e87267a1a91149ffb8c5db7e4c35a24c&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=8bd0b3ec424b423da0670486cc02bc49 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:37.868566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:37.903836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774f32-b63d-47e9-b10e-e42f1baa6bc1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:37.945134 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8053de7-ebcc-4627-91ee-6742e1eec850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:37.945820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8053de7-ebcc-4627-91ee-6742e1eec850 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:37.946112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8053de7-ebcc-4627-91ee-6742e1eec850 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:37.946398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8053de7-ebcc-4627-91ee-6742e1eec850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:37.947317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8053de7-ebcc-4627-91ee-6742e1eec850 None admin] RBAC: Adding query filter params (role.id=c78e303f11a84bcd80e78de27d7d26f2, scope.project.id=81153851a37d4d1bb980a6b4efce47fa, user.id=e87267a1a91149ffb8c5db7e4c35a24c) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:37.948306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8053de7-ebcc-4627-91ee-6742e1eec850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:37.949974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8053de7-ebcc-4627-91ee-6742e1eec850 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:37.963854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 48/97] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:37 2022] GET /identity/v3/role_assignments?user.id=e87267a1a91149ffb8c5db7e4c35a24c&scope.project.id=81153851a37d4d1bb980a6b4efce47fa&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:39.349253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7554241-e4b8-4cca-aacf-65136ad986d4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:39.350246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7554241-e4b8-4cca-aacf-65136ad986d4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:39.350826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7554241-e4b8-4cca-aacf-65136ad986d4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:39.352461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 50/98] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:39.358786 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5124d-de0f-43f3-b487-86278af7e6b8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:39.359698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5124d-de0f-43f3-b487-86278af7e6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:39.360189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5124d-de0f-43f3-b487-86278af7e6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:39.384166 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7aa5124d-de0f-43f3-b487-86278af7e6b8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:39.386300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7aa5124d-de0f-43f3-b487-86278af7e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:39.453181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac2698-2ed2-480f-a283-26c6d96bea29 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:39.453494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac2698-2ed2-480f-a283-26c6d96bea29 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:39.453766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac2698-2ed2-480f-a283-26c6d96bea29 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:39.455145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 51/99] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:43:39.460397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a49c48-812f-4bc9-bf8c-172e037a5a54 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:39.460699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a49c48-812f-4bc9-bf8c-172e037a5a54 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:39.460991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a49c48-812f-4bc9-bf8c-172e037a5a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:39.485725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-04a49c48-812f-4bc9-bf8c-172e037a5a54 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:39.495182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-04a49c48-812f-4bc9-bf8c-172e037a5a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:39.516854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 49/100] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:39.558703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5124d-de0f-43f3-b487-86278af7e6b8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:39.649327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 52/101] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:43:39.683083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a49c48-812f-4bc9-bf8c-172e037a5a54 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:39.700937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:39.737957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:39.787389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5124d-de0f-43f3-b487-86278af7e6b8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:39.851972 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbbccd-f523-4b62-88df-9f75c9eaa64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:39.852823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbbccd-f523-4b62-88df-9f75c9eaa64b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:39.853115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbbccd-f523-4b62-88df-9f75c9eaa64b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:39.853394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbbccd-f523-4b62-88df-9f75c9eaa64b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:39.859514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbbccd-f523-4b62-88df-9f75c9eaa64b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:39.861007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbbccd-f523-4b62-88df-9f75c9eaa64b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:39.862884 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 50/102] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:39.870727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbbccd-f523-4b62-88df-9f75c9eaa64b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:39.930089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a49c48-812f-4bc9-bf8c-172e037a5a54 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:40.025932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b2260-1b48-49fd-9cbc-e27c7ed8779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:40.026818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b2260-1b48-49fd-9cbc-e27c7ed8779d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:40.027108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b2260-1b48-49fd-9cbc-e27c7ed8779d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:40.027414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b2260-1b48-49fd-9cbc-e27c7ed8779d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:40.039476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b2260-1b48-49fd-9cbc-e27c7ed8779d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8f4b2260-1b48-49fd-9cbc-e27c7ed8779d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:40.048781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:40.049908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:40.050871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 53/103] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:43:40.060264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b2260-1b48-49fd-9cbc-e27c7ed8779d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:40.127395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbbccd-f523-4b62-88df-9f75c9eaa64b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:40.217660 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04446e0-85d7-4766-af51-1f096bc136d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:40.218293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04446e0-85d7-4766-af51-1f096bc136d1 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:40.218591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04446e0-85d7-4766-af51-1f096bc136d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:40.218867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04446e0-85d7-4766-af51-1f096bc136d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:40.219612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04446e0-85d7-4766-af51-1f096bc136d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:40.221086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04446e0-85d7-4766-af51-1f096bc136d1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:40.227489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:40.258142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:40.274116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 51/104] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:43:39 2022] POST /identity/v3/projects => generated 302 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:43:40.280005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7dc01-f497-469a-b757-2029279fcd59 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:40.280301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7dc01-f497-469a-b757-2029279fcd59 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:40.280583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7dc01-f497-469a-b757-2029279fcd59 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:40.282708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 52/105] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:40.287857 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b2260-1b48-49fd-9cbc-e27c7ed8779d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:40.290785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900689b-0853-4bd1-ab1a-d74eb0d88b9e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:40.291114 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900689b-0853-4bd1-ab1a-d74eb0d88b9e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:40.291935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900689b-0853-4bd1-ab1a-d74eb0d88b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:40.337352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f900689b-0853-4bd1-ab1a-d74eb0d88b9e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:40.341295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f900689b-0853-4bd1-ab1a-d74eb0d88b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:40.386053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e32f93-8e41-41ab-9d69-a283623208de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:40.386719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32f93-8e41-41ab-9d69-a283623208de None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:40.387016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32f93-8e41-41ab-9d69-a283623208de None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:40.387323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32f93-8e41-41ab-9d69-a283623208de None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:40.389946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e32f93-8e41-41ab-9d69-a283623208de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:40.390269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e32f93-8e41-41ab-9d69-a283623208de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:40.392898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e32f93-8e41-41ab-9d69-a283623208de None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:40.412274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 54/106] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:40.414478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663db40-5bb2-4e85-bbeb-12285fb9f430 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:40.414778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663db40-5bb2-4e85-bbeb-12285fb9f430 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:40.415065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663db40-5bb2-4e85-bbeb-12285fb9f430 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:40.417561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 55/107] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:40.419406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663db40-5bb2-4e85-bbeb-12285fb9f430 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:40.511433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 53/108] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:40.512771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c37336-53f5-48fa-ad7b-7c4ab04787ba None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:40.513075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c37336-53f5-48fa-ad7b-7c4ab04787ba None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:40.513365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c37336-53f5-48fa-ad7b-7c4ab04787ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:40.552410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-12c37336-53f5-48fa-ad7b-7c4ab04787ba None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:40.553855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-12c37336-53f5-48fa-ad7b-7c4ab04787ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:40.562672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663db40-5bb2-4e85-bbeb-12285fb9f430 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:40.616076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab481f2f-8281-4633-8eb5-4f5c47cf5944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:40.616976 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab481f2f-8281-4633-8eb5-4f5c47cf5944 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:40.617269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab481f2f-8281-4633-8eb5-4f5c47cf5944 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:40.617549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab481f2f-8281-4633-8eb5-4f5c47cf5944 None admin] PATH_INFO: `/v3/users/196de2cd9123446394cdfdf1e0a1325a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:40.642335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab481f2f-8281-4633-8eb5-4f5c47cf5944 None admin] RBAC: Authorizing `identity:get_user(user_id=196de2cd9123446394cdfdf1e0a1325a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:40.643419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab481f2f-8281-4633-8eb5-4f5c47cf5944 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:40.645423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 56/109] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:40 2022] GET /identity/v3/users/196de2cd9123446394cdfdf1e0a1325a => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:40.652724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab481f2f-8281-4633-8eb5-4f5c47cf5944 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:40.659486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:40.672898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 54/110] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:40.675691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c37336-53f5-48fa-ad7b-7c4ab04787ba None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:40.750741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:40.792887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab481f2f-8281-4633-8eb5-4f5c47cf5944 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:40.832616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663badec-0d3f-43a4-9f40-3d1bbfae5fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:40.833428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663badec-0d3f-43a4-9f40-3d1bbfae5fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:40.833718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663badec-0d3f-43a4-9f40-3d1bbfae5fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:40.833996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663badec-0d3f-43a4-9f40-3d1bbfae5fb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:40.836360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c37336-53f5-48fa-ad7b-7c4ab04787ba None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:40.859969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663badec-0d3f-43a4-9f40-3d1bbfae5fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-663badec-0d3f-43a4-9f40-3d1bbfae5fb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:40.867915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:40.868793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:40.870179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:40.875247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 57/111] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:40.876378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663badec-0d3f-43a4-9f40-3d1bbfae5fb1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:40.915698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32765ee2-fd9f-4955-a3f2-d64ac33c8e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:40.917151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32765ee2-fd9f-4955-a3f2-d64ac33c8e4b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:40.917916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32765ee2-fd9f-4955-a3f2-d64ac33c8e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:40.918208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32765ee2-fd9f-4955-a3f2-d64ac33c8e4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:40.994158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:41.027524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663badec-0d3f-43a4-9f40-3d1bbfae5fb1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:41.071242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32765ee2-fd9f-4955-a3f2-d64ac33c8e4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:41.073326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32765ee2-fd9f-4955-a3f2-d64ac33c8e4b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:41.073523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb65a9-82ca-4981-a98b-46ce9f952406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:41.074669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb65a9-82ca-4981-a98b-46ce9f952406 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.075121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb65a9-82ca-4981-a98b-46ce9f952406 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.075590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb65a9-82ca-4981-a98b-46ce9f952406 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.091430 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb65a9-82ca-4981-a98b-46ce9f952406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-87eb65a9-82ca-4981-a98b-46ce9f952406 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:41.099541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:41.100416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:41.101604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 58/112] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:41.102264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb65a9-82ca-4981-a98b-46ce9f952406 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:41.163763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:41.228071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb65a9-82ca-4981-a98b-46ce9f952406 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:41.231903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 55/113] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:41.232760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32765ee2-fd9f-4955-a3f2-d64ac33c8e4b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:41.267605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:41.272740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10b080-6fd9-4a69-9ab6-ac8102258357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:41.273629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10b080-6fd9-4a69-9ab6-ac8102258357 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.273924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10b080-6fd9-4a69-9ab6-ac8102258357 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.274280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10b080-6fd9-4a69-9ab6-ac8102258357 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.275149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10b080-6fd9-4a69-9ab6-ac8102258357 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:41.276013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10b080-6fd9-4a69-9ab6-ac8102258357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:41.277579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10b080-6fd9-4a69-9ab6-ac8102258357 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:41.286371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 59/114] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:41.287763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f35c5-f181-4506-8cb1-34f56dc14362 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.288025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f35c5-f181-4506-8cb1-34f56dc14362 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.288312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f35c5-f181-4506-8cb1-34f56dc14362 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.289571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 60/115] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:41.291423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f35c5-f181-4506-8cb1-34f56dc14362 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:41.372395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32765ee2-fd9f-4955-a3f2-d64ac33c8e4b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:41.413944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f35c5-f181-4506-8cb1-34f56dc14362 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:41.425935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d436453-80ef-41a8-bf14-33bc95776407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:41.426618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d436453-80ef-41a8-bf14-33bc95776407 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.426912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d436453-80ef-41a8-bf14-33bc95776407 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.427218 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d436453-80ef-41a8-bf14-33bc95776407 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.428197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d436453-80ef-41a8-bf14-33bc95776407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:41.428511 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d436453-80ef-41a8-bf14-33bc95776407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:41.429930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d436453-80ef-41a8-bf14-33bc95776407 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:41.439483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 56/116] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:41.445508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddcc67-b469-4fde-837a-47b342151acc None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.445931 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddcc67-b469-4fde-837a-47b342151acc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.446323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddcc67-b469-4fde-837a-47b342151acc None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.449156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 57/117] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:41.449793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddcc67-b469-4fde-837a-47b342151acc None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:41.461228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883408f9-adf8-46dd-9d63-ed5acddd7344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:41.462537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883408f9-adf8-46dd-9d63-ed5acddd7344 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.462828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883408f9-adf8-46dd-9d63-ed5acddd7344 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.463727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883408f9-adf8-46dd-9d63-ed5acddd7344 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.464431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:41.465407 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883408f9-adf8-46dd-9d63-ed5acddd7344 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:41.466882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883408f9-adf8-46dd-9d63-ed5acddd7344 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:41.468675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 61/118] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:41 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:41.469944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd396f0a-35cd-4780-8076-ff6a4bffce1e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.470207 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd396f0a-35cd-4780-8076-ff6a4bffce1e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.470493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd396f0a-35cd-4780-8076-ff6a4bffce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.488310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bd396f0a-35cd-4780-8076-ff6a4bffce1e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:41.489534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bd396f0a-35cd-4780-8076-ff6a4bffce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:41.545730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:41.571196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 62/119] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:41.571196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd396f0a-35cd-4780-8076-ff6a4bffce1e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:41.579206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddcc67-b469-4fde-837a-47b342151acc None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:41.617703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae93b-bf87-474b-ae01-ef430208018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:41.618595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae93b-bf87-474b-ae01-ef430208018f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.618887 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae93b-bf87-474b-ae01-ef430208018f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.619201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae93b-bf87-474b-ae01-ef430208018f None admin] PATH_INFO: `/v3/users/e87267a1a91149ffb8c5db7e4c35a24c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.621569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ae93b-bf87-474b-ae01-ef430208018f None admin] RBAC: Authorizing `identity:get_user(user_id=e87267a1a91149ffb8c5db7e4c35a24c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:41.623105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ae93b-bf87-474b-ae01-ef430208018f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:41.624909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 58/120] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:41 2022] GET /identity/v3/users/e87267a1a91149ffb8c5db7e4c35a24c => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:41.628603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fce94-9c27-4dac-85ab-f118f55c62aa None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.629223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fce94-9c27-4dac-85ab-f118f55c62aa None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.629735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fce94-9c27-4dac-85ab-f118f55c62aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.648659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5e3fce94-9c27-4dac-85ab-f118f55c62aa None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:41.649911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5e3fce94-9c27-4dac-85ab-f118f55c62aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:41.689129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd396f0a-35cd-4780-8076-ff6a4bffce1e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:41.722415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 59/121] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:41.723597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fce94-9c27-4dac-85ab-f118f55c62aa None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:41.734776 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc5f5-a5d2-48d0-ad53-03ff14ce9c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:41.735830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc5f5-a5d2-48d0-ad53-03ff14ce9c53 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.736125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc5f5-a5d2-48d0-ad53-03ff14ce9c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.736452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc5f5-a5d2-48d0-ad53-03ff14ce9c53 None admin] PATH_INFO: `/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.737220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:41.738162 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc5f5-a5d2-48d0-ad53-03ff14ce9c53 None admin] RBAC: Authorizing `identity:get_user(user_id=0a08a935c7f043a7a9ef4df0003ddf4c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:41.740273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc5f5-a5d2-48d0-ad53-03ff14ce9c53 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:41.747709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 63/122] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:41 2022] GET /identity/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:41.747709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc5f5-a5d2-48d0-ad53-03ff14ce9c53 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:41.815598 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:41.849653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fce94-9c27-4dac-85ab-f118f55c62aa None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:41.874747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc5f5-a5d2-48d0-ad53-03ff14ce9c53 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:41.890007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac746d32-77f4-42f7-b773-187667ba0cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:41.890683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746d32-77f4-42f7-b773-187667ba0cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.890976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746d32-77f4-42f7-b773-187667ba0cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.891295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746d32-77f4-42f7-b773-187667ba0cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.892148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac746d32-77f4-42f7-b773-187667ba0cc1 None admin] RBAC: Adding query filter params (role.id=5a49025933754ca3a061316bbeafb7e3, scope.project.id=21ac6b9f65304534adce7421674442c6, user.id=196de2cd9123446394cdfdf1e0a1325a) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:41.892481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac746d32-77f4-42f7-b773-187667ba0cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:41.893944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac746d32-77f4-42f7-b773-187667ba0cc1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:41.902731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 60/123] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:41 2022] GET /identity/v3/role_assignments?user.id=196de2cd9123446394cdfdf1e0a1325a&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=5a49025933754ca3a061316bbeafb7e3 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:41.902731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac746d32-77f4-42f7-b773-187667ba0cc1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:41.923355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c58d4-3195-4fe3-82fa-b344a70e838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:41.924557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c58d4-3195-4fe3-82fa-b344a70e838a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:41.925172 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c58d4-3195-4fe3-82fa-b344a70e838a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:41.925712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c58d4-3195-4fe3-82fa-b344a70e838a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:41.949023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c58d4-3195-4fe3-82fa-b344a70e838a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-844c58d4-3195-4fe3-82fa-b344a70e838a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:41.958094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:41.959027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:41.959826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:41.962043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 64/124] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:41.963207 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c58d4-3195-4fe3-82fa-b344a70e838a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:42.013208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:42.070291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac746d32-77f4-42f7-b773-187667ba0cc1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:42.102904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c58d4-3195-4fe3-82fa-b344a70e838a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:42.118401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f792088-2692-43b0-ab86-1f2a9df03bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:42.120330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f792088-2692-43b0-ab86-1f2a9df03bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.120848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:42.121113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f792088-2692-43b0-ab86-1f2a9df03bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.121423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f792088-2692-43b0-ab86-1f2a9df03bf1 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.123832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f792088-2692-43b0-ab86-1f2a9df03bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:42.125919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f792088-2692-43b0-ab86-1f2a9df03bf1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:42.131403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 61/125] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:41 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:42.131403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f792088-2692-43b0-ab86-1f2a9df03bf1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:42.151819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac3034-3504-4241-94f4-13aed0426cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:42.152878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac3034-3504-4241-94f4-13aed0426cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.153274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac3034-3504-4241-94f4-13aed0426cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.153788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac3034-3504-4241-94f4-13aed0426cc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.165613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac3034-3504-4241-94f4-13aed0426cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c4ac3034-3504-4241-94f4-13aed0426cc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:42.175415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:42.176500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:42.177354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:42.178289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 65/126] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:43:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:42.179243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac3034-3504-4241-94f4-13aed0426cc3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:42.260555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f792088-2692-43b0-ab86-1f2a9df03bf1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:42.298096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17c5e2-a71d-476d-9751-6006588ca596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:42.299190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17c5e2-a71d-476d-9751-6006588ca596 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.299580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17c5e2-a71d-476d-9751-6006588ca596 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.299936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17c5e2-a71d-476d-9751-6006588ca596 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.301340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17c5e2-a71d-476d-9751-6006588ca596 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:42.302735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac3034-3504-4241-94f4-13aed0426cc3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:42.302900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17c5e2-a71d-476d-9751-6006588ca596 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:42.304859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 62/127] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:42 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:42.310357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17c5e2-a71d-476d-9751-6006588ca596 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:42.320320 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:42.343348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933c41a-152d-44f0-8a6d-0f45ed9216a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:42.344150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933c41a-152d-44f0-8a6d-0f45ed9216a4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.344478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933c41a-152d-44f0-8a6d-0f45ed9216a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.344827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933c41a-152d-44f0-8a6d-0f45ed9216a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.345661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933c41a-152d-44f0-8a6d-0f45ed9216a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:42.346043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933c41a-152d-44f0-8a6d-0f45ed9216a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:42.347567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933c41a-152d-44f0-8a6d-0f45ed9216a4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:42.358327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 66/128] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:42.363565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933c41a-152d-44f0-8a6d-0f45ed9216a4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:42.403690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:42.427077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17c5e2-a71d-476d-9751-6006588ca596 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:42.463306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0ba8f-7519-477b-9b9a-5ca7b41ad007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:42.464350 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0ba8f-7519-477b-9b9a-5ca7b41ad007 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.464636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0ba8f-7519-477b-9b9a-5ca7b41ad007 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.465046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0ba8f-7519-477b-9b9a-5ca7b41ad007 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6/users/e87267a1a91149ffb8c5db7e4c35a24c/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.467223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0ba8f-7519-477b-9b9a-5ca7b41ad007 None admin] RBAC: Authorizing `identity:create_grant(project_id=21ac6b9f65304534adce7421674442c6, user_id=e87267a1a91149ffb8c5db7e4c35a24c, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:42.468791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0ba8f-7519-477b-9b9a-5ca7b41ad007 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:42.483277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933c41a-152d-44f0-8a6d-0f45ed9216a4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:42.484318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 63/129] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:43:42 2022] PUT /identity/v3/projects/21ac6b9f65304534adce7421674442c6/users/e87267a1a91149ffb8c5db7e4c35a24c/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:43:42.491975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0ba8f-7519-477b-9b9a-5ca7b41ad007 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:42.534402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f1e1-e104-401f-af29-81cb9bd3b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:42.535548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f1e1-e104-401f-af29-81cb9bd3b58f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.536046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f1e1-e104-401f-af29-81cb9bd3b58f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.536504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f1e1-e104-401f-af29-81cb9bd3b58f None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.537526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f1e1-e104-401f-af29-81cb9bd3b58f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:42.538018 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f1e1-e104-401f-af29-81cb9bd3b58f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:42.539728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f1e1-e104-401f-af29-81cb9bd3b58f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:42.559767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 67/130] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:43:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:42.564653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f1e1-e104-401f-af29-81cb9bd3b58f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:42.591204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:42.621126 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0ba8f-7519-477b-9b9a-5ca7b41ad007 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:42.682534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a9f4c-fff9-48cf-a06a-28c3106ada9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:42.683633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a9f4c-fff9-48cf-a06a-28c3106ada9a None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.684004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a9f4c-fff9-48cf-a06a-28c3106ada9a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.684368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a9f4c-fff9-48cf-a06a-28c3106ada9a None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6/users/0a08a935c7f043a7a9ef4df0003ddf4c/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.686774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a9f4c-fff9-48cf-a06a-28c3106ada9a None admin] RBAC: Authorizing `identity:create_grant(project_id=21ac6b9f65304534adce7421674442c6, user_id=0a08a935c7f043a7a9ef4df0003ddf4c, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:42.688465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a9f4c-fff9-48cf-a06a-28c3106ada9a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:42.707794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 64/131] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:43:42 2022] PUT /identity/v3/projects/21ac6b9f65304534adce7421674442c6/users/0a08a935c7f043a7a9ef4df0003ddf4c/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:43:42.708846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a9f4c-fff9-48cf-a06a-28c3106ada9a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:42.716234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:42.737659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f1e1-e104-401f-af29-81cb9bd3b58f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:42.836993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2078b64-1eca-4450-b328-602a678b1100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:42.839228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2078b64-1eca-4450-b328-602a678b1100 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.839526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2078b64-1eca-4450-b328-602a678b1100 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.839820 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2078b64-1eca-4450-b328-602a678b1100 None admin] PATH_INFO: `/v3/users/e87267a1a91149ffb8c5db7e4c35a24c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.841426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2078b64-1eca-4450-b328-602a678b1100 None admin] RBAC: Authorizing `identity:get_user(user_id=e87267a1a91149ffb8c5db7e4c35a24c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:42.843352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2078b64-1eca-4450-b328-602a678b1100 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:42.846344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 68/132] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:42 2022] GET /identity/v3/users/e87267a1a91149ffb8c5db7e4c35a24c => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:42.847881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19608e5-5cb2-4d79-a049-7de18fffccca None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.848218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19608e5-5cb2-4d79-a049-7de18fffccca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.848682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19608e5-5cb2-4d79-a049-7de18fffccca None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.850732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 69/133] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:42.856556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19608e5-5cb2-4d79-a049-7de18fffccca None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:42.896507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a9f4c-fff9-48cf-a06a-28c3106ada9a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:42.935968 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:42.949955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61573c70-342f-4675-9b03-2b39d6f7676f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:42.950858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61573c70-342f-4675-9b03-2b39d6f7676f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.951247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61573c70-342f-4675-9b03-2b39d6f7676f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.951731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61573c70-342f-4675-9b03-2b39d6f7676f None admin] PATH_INFO: `/v3/users/e87267a1a91149ffb8c5db7e4c35a24c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.953795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61573c70-342f-4675-9b03-2b39d6f7676f None admin] RBAC: Authorizing `identity:get_user(user_id=e87267a1a91149ffb8c5db7e4c35a24c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:42.956823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61573c70-342f-4675-9b03-2b39d6f7676f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:42.958863 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 65/134] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:42 2022] GET /identity/v3/users/e87267a1a91149ffb8c5db7e4c35a24c => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:42.960423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f566406-a119-4da0-a342-7e0c241ff6f0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:42.961664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f566406-a119-4da0-a342-7e0c241ff6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:42.961664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f566406-a119-4da0-a342-7e0c241ff6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:42.985436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9f566406-a119-4da0-a342-7e0c241ff6f0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:42.986675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9f566406-a119-4da0-a342-7e0c241ff6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:43.006438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19608e5-5cb2-4d79-a049-7de18fffccca None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:43.046030 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468473fb-3f2b-4714-8605-17c96d6c8747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:43.047266 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468473fb-3f2b-4714-8605-17c96d6c8747 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:43.047776 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468473fb-3f2b-4714-8605-17c96d6c8747 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:43.048454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468473fb-3f2b-4714-8605-17c96d6c8747 None admin] PATH_INFO: `/v3/projects/81153851a37d4d1bb980a6b4efce47fa` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:43.050636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468473fb-3f2b-4714-8605-17c96d6c8747 None admin] RBAC: Authorizing `identity:get_project(project_id=81153851a37d4d1bb980a6b4efce47fa)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:43.052534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468473fb-3f2b-4714-8605-17c96d6c8747 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:43.054556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 70/135] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:42 2022] GET /identity/v3/projects/81153851a37d4d1bb980a6b4efce47fa => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:43.055676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468473fb-3f2b-4714-8605-17c96d6c8747 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:43.075441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 66/136] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:43.076464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f566406-a119-4da0-a342-7e0c241ff6f0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:43.090683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:43.217288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f566406-a119-4da0-a342-7e0c241ff6f0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:43.253931 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:43.274924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20d2d9-484d-4c7c-8992-db4747ea810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:43.276666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20d2d9-484d-4c7c-8992-db4747ea810a None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:43.277070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20d2d9-484d-4c7c-8992-db4747ea810a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:43.277351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20d2d9-484d-4c7c-8992-db4747ea810a None admin] PATH_INFO: `/v3/projects/81153851a37d4d1bb980a6b4efce47fa/users/e87267a1a91149ffb8c5db7e4c35a24c/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:43.286636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20d2d9-484d-4c7c-8992-db4747ea810a None admin] RBAC: Authorizing `identity:create_grant(project_id=81153851a37d4d1bb980a6b4efce47fa, user_id=e87267a1a91149ffb8c5db7e4c35a24c, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:43.288132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20d2d9-484d-4c7c-8992-db4747ea810a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:43.312167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468473fb-3f2b-4714-8605-17c96d6c8747 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:43.312912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 67/137] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:43:43 2022] PUT /identity/v3/projects/81153851a37d4d1bb980a6b4efce47fa/users/e87267a1a91149ffb8c5db7e4c35a24c/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:43:43.313768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20d2d9-484d-4c7c-8992-db4747ea810a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:43.391004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d9d6e-b6d5-409d-b9ce-bc0076d2a376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:43.392013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9d6e-b6d5-409d-b9ce-bc0076d2a376 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:43.392210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9d6e-b6d5-409d-b9ce-bc0076d2a376 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:43.392596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9d6e-b6d5-409d-b9ce-bc0076d2a376 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:43.395993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d9d6e-b6d5-409d-b9ce-bc0076d2a376 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:43.397885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d9d6e-b6d5-409d-b9ce-bc0076d2a376 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:43.404226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 71/138] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:43 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:43.409897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d9d6e-b6d5-409d-b9ce-bc0076d2a376 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:43.472105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20d2d9-484d-4c7c-8992-db4747ea810a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:43.538410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8502e-3043-4386-908f-2240c50d9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:43.539247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8502e-3043-4386-908f-2240c50d9745 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:43.539540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8502e-3043-4386-908f-2240c50d9745 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:43.539820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8502e-3043-4386-908f-2240c50d9745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:43.544311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8502e-3043-4386-908f-2240c50d9745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:43.547882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8502e-3043-4386-908f-2240c50d9745 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:43.549618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 68/139] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:43.573691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8502e-3043-4386-908f-2240c50d9745 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:43.656265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:43.661567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:43.667559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d9d6e-b6d5-409d-b9ce-bc0076d2a376 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:43.719897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8502e-3043-4386-908f-2240c50d9745 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:43.764218 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17e905-1075-44bf-9307-4226c2ebcd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:43.766057 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17e905-1075-44bf-9307-4226c2ebcd20 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:43.766999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17e905-1075-44bf-9307-4226c2ebcd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:43.767852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17e905-1075-44bf-9307-4226c2ebcd20 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:43.769096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17e905-1075-44bf-9307-4226c2ebcd20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:43.770383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c7d84-f9d1-4950-9023-8c9786e4b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:43.772292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c7d84-f9d1-4950-9023-8c9786e4b9b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:43.773132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17e905-1075-44bf-9307-4226c2ebcd20 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:43.773572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c7d84-f9d1-4950-9023-8c9786e4b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:43.774001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c7d84-f9d1-4950-9023-8c9786e4b9b0 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6/users/e87267a1a91149ffb8c5db7e4c35a24c/roles/8bd0b3ec424b423da0670486cc02bc49` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:43.784585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c7d84-f9d1-4950-9023-8c9786e4b9b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=21ac6b9f65304534adce7421674442c6, user_id=e87267a1a91149ffb8c5db7e4c35a24c, role_id=8bd0b3ec424b423da0670486cc02bc49)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:43.786221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c7d84-f9d1-4950-9023-8c9786e4b9b0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:43.815452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 72/140] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:43:43 2022] PUT /identity/v3/projects/21ac6b9f65304534adce7421674442c6/users/e87267a1a91149ffb8c5db7e4c35a24c/roles/8bd0b3ec424b423da0670486cc02bc49 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:43:43.819131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 69/141] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:43:43 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:43:44.654553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8f11-b7ab-4456-aa47-07c2e0ec5cfc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:44.654919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8f11-b7ab-4456-aa47-07c2e0ec5cfc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:44.655138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8f11-b7ab-4456-aa47-07c2e0ec5cfc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:44.656699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 73/142] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:44.662188 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c744d-8a26-435c-833c-1849e7d8dec7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:44.662651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c744d-8a26-435c-833c-1849e7d8dec7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:44.662829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c744d-8a26-435c-833c-1849e7d8dec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:44.687243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0a0c744d-8a26-435c-833c-1849e7d8dec7 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:44.688804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0a0c744d-8a26-435c-833c-1849e7d8dec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:44.778071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 70/143] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:44.802159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e8f11-b7ab-4456-aa47-07c2e0ec5cfc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:44.927517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e8f11-b7ab-4456-aa47-07c2e0ec5cfc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:44.971984 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ac1ca-b3ec-43f9-add0-08780a8eff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:44.972800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ac1ca-b3ec-43f9-add0-08780a8eff8b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:44.973091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ac1ca-b3ec-43f9-add0-08780a8eff8b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:44.973373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ac1ca-b3ec-43f9-add0-08780a8eff8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:44.985025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ac1ca-b3ec-43f9-add0-08780a8eff8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e73ac1ca-b3ec-43f9-add0-08780a8eff8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:44.993184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:44.994035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:44.995470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 74/144] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:45.006067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c744d-8a26-435c-833c-1849e7d8dec7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:45.050436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:45.127498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c744d-8a26-435c-833c-1849e7d8dec7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:45.172042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59f618-7b93-4979-9017-ea731f65cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:45.172730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59f618-7b93-4979-9017-ea731f65cc1c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:45.173024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59f618-7b93-4979-9017-ea731f65cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:45.173308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59f618-7b93-4979-9017-ea731f65cc1c None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:45.174077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59f618-7b93-4979-9017-ea731f65cc1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:45.174396 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59f618-7b93-4979-9017-ea731f65cc1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:45.175995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59f618-7b93-4979-9017-ea731f65cc1c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:45.188141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 71/145] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:45.193814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ac1ca-b3ec-43f9-add0-08780a8eff8b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:45.220186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:45.313169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ac1ca-b3ec-43f9-add0-08780a8eff8b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:45.350491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0ab4a-dec6-48a2-acb0-4fcc38859671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:45.351404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0ab4a-dec6-48a2-acb0-4fcc38859671 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:45.351691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0ab4a-dec6-48a2-acb0-4fcc38859671 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:45.351971 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0ab4a-dec6-48a2-acb0-4fcc38859671 None admin] PATH_INFO: `/v3/users/196de2cd9123446394cdfdf1e0a1325a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:45.353233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0ab4a-dec6-48a2-acb0-4fcc38859671 None admin] RBAC: Authorizing `identity:get_user(user_id=196de2cd9123446394cdfdf1e0a1325a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:45.354904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0ab4a-dec6-48a2-acb0-4fcc38859671 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:45.356895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 75/146] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:45 2022] GET /identity/v3/users/196de2cd9123446394cdfdf1e0a1325a => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:45.362535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59f618-7b93-4979-9017-ea731f65cc1c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:45.469776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:45.472837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59f618-7b93-4979-9017-ea731f65cc1c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:45.529997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67567d4-bc09-44d6-abcd-76c97fa09f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:45.530875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67567d4-bc09-44d6-abcd-76c97fa09f63 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:45.531184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67567d4-bc09-44d6-abcd-76c97fa09f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:45.531477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67567d4-bc09-44d6-abcd-76c97fa09f63 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:45.533435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67567d4-bc09-44d6-abcd-76c97fa09f63 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:45.534969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67567d4-bc09-44d6-abcd-76c97fa09f63 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:45.537091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 72/147] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:45 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:45.543251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0ab4a-dec6-48a2-acb0-4fcc38859671 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:45.660668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:45.676063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0ab4a-dec6-48a2-acb0-4fcc38859671 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:45.719403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c4816-e363-4909-87ca-1c267cafd06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:45.720369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c4816-e363-4909-87ca-1c267cafd06e None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:45.720608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c4816-e363-4909-87ca-1c267cafd06e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:45.720896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c4816-e363-4909-87ca-1c267cafd06e None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6/users/196de2cd9123446394cdfdf1e0a1325a/roles/5a49025933754ca3a061316bbeafb7e3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:45.722973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c4816-e363-4909-87ca-1c267cafd06e None admin] RBAC: Authorizing `identity:create_grant(project_id=21ac6b9f65304534adce7421674442c6, user_id=196de2cd9123446394cdfdf1e0a1325a, role_id=5a49025933754ca3a061316bbeafb7e3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:45.724528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c4816-e363-4909-87ca-1c267cafd06e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:45.743367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 76/148] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:43:45 2022] PUT /identity/v3/projects/21ac6b9f65304534adce7421674442c6/users/196de2cd9123446394cdfdf1e0a1325a/roles/5a49025933754ca3a061316bbeafb7e3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:43:45.744808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d1c09-59df-45a8-a077-51a1f20d6c67 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:45.745721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d1c09-59df-45a8-a077-51a1f20d6c67 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:45.746246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d1c09-59df-45a8-a077-51a1f20d6c67 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:45.748010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 73/149] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:45.754460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2d5cd-4b75-4f59-9239-7cd3a81ece62 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:45.754648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab50f5-1123-4867-a12b-45982694e16a None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:45.754860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2d5cd-4b75-4f59-9239-7cd3a81ece62 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:45.755039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2d5cd-4b75-4f59-9239-7cd3a81ece62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:45.755666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab50f5-1123-4867-a12b-45982694e16a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:45.756172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab50f5-1123-4867-a12b-45982694e16a None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:45.757909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 74/150] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:45.774124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-07c2d5cd-4b75-4f59-9239-7cd3a81ece62 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:45.775960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c41b-e9cd-4e0a-967b-4018dad31734 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:45.776085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-07c2d5cd-4b75-4f59-9239-7cd3a81ece62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:45.776702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c41b-e9cd-4e0a-967b-4018dad31734 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:45.777189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c41b-e9cd-4e0a-967b-4018dad31734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:45.812739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-21b7c41b-e9cd-4e0a-967b-4018dad31734 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:45.815248 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-21b7c41b-e9cd-4e0a-967b-4018dad31734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:45.932765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 77/151] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:45.965825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 75/152] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:43:46.014520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2d5cd-4b75-4f59-9239-7cd3a81ece62 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:46.014691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c41b-e9cd-4e0a-967b-4018dad31734 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:46.144473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:46.159663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:46.164602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c41b-e9cd-4e0a-967b-4018dad31734 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:46.192856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2d5cd-4b75-4f59-9239-7cd3a81ece62 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:46.246021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26f2a2-c8f4-4161-ac1c-a0a476034640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:46.246831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26f2a2-c8f4-4161-ac1c-a0a476034640 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:46.247114 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26f2a2-c8f4-4161-ac1c-a0a476034640 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:46.247417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26f2a2-c8f4-4161-ac1c-a0a476034640 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:46.274740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1decc78-851f-4748-9005-5e8b4a17c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:46.276192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1decc78-851f-4748-9005-5e8b4a17c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:46.276473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1decc78-851f-4748-9005-5e8b4a17c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:46.276747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1decc78-851f-4748-9005-5e8b4a17c5d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:46.281899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26f2a2-c8f4-4161-ac1c-a0a476034640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-4c26f2a2-c8f4-4161-ac1c-a0a476034640 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:46.290124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:46.291197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:46.292187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:43:46.293466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 76/153] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:46.300171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26f2a2-c8f4-4161-ac1c-a0a476034640 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:46.312188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1decc78-851f-4748-9005-5e8b4a17c5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c1decc78-851f-4748-9005-5e8b4a17c5d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:46.321193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:46.324016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:46.325955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:46.329061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 78/154] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:46.335012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1decc78-851f-4748-9005-5e8b4a17c5d6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:46.498034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26f2a2-c8f4-4161-ac1c-a0a476034640 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:46.528649 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1decc78-851f-4748-9005-5e8b4a17c5d6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:46.565554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cd6e0-da5f-47c2-b51e-f91525bbb7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:46.566235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cd6e0-da5f-47c2-b51e-f91525bbb7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:46.566519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cd6e0-da5f-47c2-b51e-f91525bbb7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:46.566801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cd6e0-da5f-47c2-b51e-f91525bbb7d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:46.567651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cd6e0-da5f-47c2-b51e-f91525bbb7d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:46.567961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cd6e0-da5f-47c2-b51e-f91525bbb7d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:46.569366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cd6e0-da5f-47c2-b51e-f91525bbb7d4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:46.584806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 77/155] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:46.592145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cd6e0-da5f-47c2-b51e-f91525bbb7d4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:46.597819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79664b-2201-4c5f-83f9-20a69ad9ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:46.598500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79664b-2201-4c5f-83f9-20a69ad9ba83 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:46.598788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79664b-2201-4c5f-83f9-20a69ad9ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:46.599065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79664b-2201-4c5f-83f9-20a69ad9ba83 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:46.599861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79664b-2201-4c5f-83f9-20a69ad9ba83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:46.600167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79664b-2201-4c5f-83f9-20a69ad9ba83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:46.601579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79664b-2201-4c5f-83f9-20a69ad9ba83 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:46.614748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:46.623609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 79/156] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:46.624736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c076d-cb12-4b66-ba68-3a345cdcfb08 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:46.625100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c076d-cb12-4b66-ba68-3a345cdcfb08 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:46.625286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c076d-cb12-4b66-ba68-3a345cdcfb08 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:46.626509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 80/157] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:46.631451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c076d-cb12-4b66-ba68-3a345cdcfb08 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:46.640071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:46.789499 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c076d-cb12-4b66-ba68-3a345cdcfb08 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:46.792473 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cd6e0-da5f-47c2-b51e-f91525bbb7d4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:46.844869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce05215-8134-4b01-84fb-18624af6cfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:46.845774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce05215-8134-4b01-84fb-18624af6cfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:46.846062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce05215-8134-4b01-84fb-18624af6cfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:46.846507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce05215-8134-4b01-84fb-18624af6cfc5 None admin] PATH_INFO: `/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:46.846728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d243e7-0bfc-4c6f-b81a-4a75826989bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:46.847861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d243e7-0bfc-4c6f-b81a-4a75826989bd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:46.848321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d243e7-0bfc-4c6f-b81a-4a75826989bd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:46.848747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d243e7-0bfc-4c6f-b81a-4a75826989bd None admin] PATH_INFO: `/v3/users/e87267a1a91149ffb8c5db7e4c35a24c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:46.851957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce05215-8134-4b01-84fb-18624af6cfc5 None admin] RBAC: Authorizing `identity:get_user(user_id=0a08a935c7f043a7a9ef4df0003ddf4c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:46.854168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce05215-8134-4b01-84fb-18624af6cfc5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:46.856003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d243e7-0bfc-4c6f-b81a-4a75826989bd None admin] RBAC: Authorizing `identity:get_user(user_id=e87267a1a91149ffb8c5db7e4c35a24c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:46.856599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 78/158] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:46 2022] GET /identity/v3/users/0a08a935c7f043a7a9ef4df0003ddf4c => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:46.857673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d243e7-0bfc-4c6f-b81a-4a75826989bd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:46.858100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c921e5-3711-49f3-9ad8-039c9987eb55 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:46.858531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c921e5-3711-49f3-9ad8-039c9987eb55 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:46.858953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c921e5-3711-49f3-9ad8-039c9987eb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:46.859446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 81/159] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:46 2022] GET /identity/v3/users/e87267a1a91149ffb8c5db7e4c35a24c => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:46.867278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d243e7-0bfc-4c6f-b81a-4a75826989bd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:46.892214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-06c921e5-3711-49f3-9ad8-039c9987eb55 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:46.893688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-06c921e5-3711-49f3-9ad8-039c9987eb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:47.005130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 79/160] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:47.006248 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c921e5-3711-49f3-9ad8-039c9987eb55 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:47.035063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:47.043021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:47.107316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d243e7-0bfc-4c6f-b81a-4a75826989bd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:47.167616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed96af1-61c1-4adb-a40f-c8294065913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:47.168752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96af1-61c1-4adb-a40f-c8294065913f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:47.169667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96af1-61c1-4adb-a40f-c8294065913f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:47.170152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96af1-61c1-4adb-a40f-c8294065913f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:47.249986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c921e5-3711-49f3-9ad8-039c9987eb55 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:47.288065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed96af1-61c1-4adb-a40f-c8294065913f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:47.289956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed96af1-61c1-4adb-a40f-c8294065913f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:47.333362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260d7bb-a7c1-433f-b505-9bc4c080dc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:47.334389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260d7bb-a7c1-433f-b505-9bc4c080dc70 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:47.334906 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260d7bb-a7c1-433f-b505-9bc4c080dc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:47.335424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260d7bb-a7c1-433f-b505-9bc4c080dc70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:47.436611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:47.517616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 82/161] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 15:43:47.518500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed96af1-61c1-4adb-a40f-c8294065913f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:47.520234 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260d7bb-a7c1-433f-b505-9bc4c080dc70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:47.521724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260d7bb-a7c1-433f-b505-9bc4c080dc70 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:47.578874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:47.753890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed96af1-61c1-4adb-a40f-c8294065913f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:47.756126 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 80/162] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:47.757176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260d7bb-a7c1-433f-b505-9bc4c080dc70 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:47.856438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e86c-1954-4470-9712-62d20b0d725e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:47.857666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e86c-1954-4470-9712-62d20b0d725e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:47.858177 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e86c-1954-4470-9712-62d20b0d725e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:47.858595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e86c-1954-4470-9712-62d20b0d725e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:47.892141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13e86c-1954-4470-9712-62d20b0d725e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:47.893607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260d7bb-a7c1-433f-b505-9bc4c080dc70 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fc13e86c-1954-4470-9712-62d20b0d725e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:47.904477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:47.905493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:47.906394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 83/163] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:47.907042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e86c-1954-4470-9712-62d20b0d725e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:47.927546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:47.967987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eaa42-ec67-4f72-a9b3-f12da7c1bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:47.968890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eaa42-ec67-4f72-a9b3-f12da7c1bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:47.969180 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eaa42-ec67-4f72-a9b3-f12da7c1bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:47.969461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eaa42-ec67-4f72-a9b3-f12da7c1bfb8 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:47.976117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6eaa42-ec67-4f72-a9b3-f12da7c1bfb8 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:47.977653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6eaa42-ec67-4f72-a9b3-f12da7c1bfb8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:47.980852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 81/164] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:47 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:47.981785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eaa42-ec67-4f72-a9b3-f12da7c1bfb8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:47.990243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:48.114985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e86c-1954-4470-9712-62d20b0d725e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:48.157924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eaa42-ec67-4f72-a9b3-f12da7c1bfb8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:48.171308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf40fa-3e1c-4dc0-976d-4d776141d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:48.172304 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf40fa-3e1c-4dc0-976d-4d776141d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:48.172838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf40fa-3e1c-4dc0-976d-4d776141d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:48.173323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf40fa-3e1c-4dc0-976d-4d776141d9f1 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:48.174751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf40fa-3e1c-4dc0-976d-4d776141d9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:48.176473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf40fa-3e1c-4dc0-976d-4d776141d9f1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:48.178406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 84/165] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:47 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:48.184957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf40fa-3e1c-4dc0-976d-4d776141d9f1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:48.251904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaaa22-c089-47ea-9fa2-1e5f3d0d0e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:48.252837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaaa22-c089-47ea-9fa2-1e5f3d0d0e7c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:48.253339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaaa22-c089-47ea-9fa2-1e5f3d0d0e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:48.253798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaaa22-c089-47ea-9fa2-1e5f3d0d0e7c None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:48.254739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaaa22-c089-47ea-9fa2-1e5f3d0d0e7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:48.255245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaaa22-c089-47ea-9fa2-1e5f3d0d0e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:48.256805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaaa22-c089-47ea-9fa2-1e5f3d0d0e7c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:48.270949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 82/166] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:48.272570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4bb8-8827-4efb-a2fa-b52b474b8375 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:48.273026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4bb8-8827-4efb-a2fa-b52b474b8375 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:48.273470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4bb8-8827-4efb-a2fa-b52b474b8375 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:48.283189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 83/167] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:48.284361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce4bb8-8827-4efb-a2fa-b52b474b8375 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:48.347003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:48.360699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf40fa-3e1c-4dc0-976d-4d776141d9f1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:48.391638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:48.423690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395ecea-01a3-44eb-85b0-e8f94263128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:48.424366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395ecea-01a3-44eb-85b0-e8f94263128b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:48.424664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395ecea-01a3-44eb-85b0-e8f94263128b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:48.424949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395ecea-01a3-44eb-85b0-e8f94263128b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:48.425814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395ecea-01a3-44eb-85b0-e8f94263128b None admin] RBAC: Adding query filter params (role.id=c78e303f11a84bcd80e78de27d7d26f2, scope.project.id=21ac6b9f65304534adce7421674442c6, user.id=e87267a1a91149ffb8c5db7e4c35a24c) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:48.426136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395ecea-01a3-44eb-85b0-e8f94263128b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:48.427640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395ecea-01a3-44eb-85b0-e8f94263128b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:48.443287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 85/168] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:48 2022] GET /identity/v3/role_assignments?user.id=e87267a1a91149ffb8c5db7e4c35a24c&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:48.444754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad67fb-7f23-4f02-a33f-289a22e30849 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:48.445051 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad67fb-7f23-4f02-a33f-289a22e30849 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:48.445336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad67fb-7f23-4f02-a33f-289a22e30849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:48.471337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c9ad67fb-7f23-4f02-a33f-289a22e30849 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:48.472573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c9ad67fb-7f23-4f02-a33f-289a22e30849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:48.517005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce4bb8-8827-4efb-a2fa-b52b474b8375 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:48.585539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412f2f1-eeab-40d0-9eb4-21c446e6c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:48.586229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412f2f1-eeab-40d0-9eb4-21c446e6c18b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:48.586522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412f2f1-eeab-40d0-9eb4-21c446e6c18b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:48.586808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412f2f1-eeab-40d0-9eb4-21c446e6c18b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:48.588251 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412f2f1-eeab-40d0-9eb4-21c446e6c18b None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=21ac6b9f65304534adce7421674442c6, user.id=0a08a935c7f043a7a9ef4df0003ddf4c) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:48.588583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412f2f1-eeab-40d0-9eb4-21c446e6c18b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:48.590621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412f2f1-eeab-40d0-9eb4-21c446e6c18b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:48.594611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 86/169] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:48.595864 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad67fb-7f23-4f02-a33f-289a22e30849 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:48.617586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 84/170] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:48 2022] GET /identity/v3/role_assignments?user.id=0a08a935c7f043a7a9ef4df0003ddf4c&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=29dae918965d40bea71d83ffa2085316 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:48.674317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412f2f1-eeab-40d0-9eb4-21c446e6c18b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:48.792460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:48.812543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad67fb-7f23-4f02-a33f-289a22e30849 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:48.828659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412f2f1-eeab-40d0-9eb4-21c446e6c18b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:48.844612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:48.870964 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80da3d-f84f-4a87-9a45-f97ed8d61d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:48.872097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80da3d-f84f-4a87-9a45-f97ed8d61d8b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:48.872554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80da3d-f84f-4a87-9a45-f97ed8d61d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:48.872988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80da3d-f84f-4a87-9a45-f97ed8d61d8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:48.880929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cf85e-6baf-4d91-a895-08313328c246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:48.883335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cf85e-6baf-4d91-a895-08313328c246 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:48.886465 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cf85e-6baf-4d91-a895-08313328c246 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:48.886934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cf85e-6baf-4d91-a895-08313328c246 None admin] PATH_INFO: `/v3/users/e87267a1a91149ffb8c5db7e4c35a24c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:48.889330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cf85e-6baf-4d91-a895-08313328c246 None admin] RBAC: Authorizing `identity:get_user(user_id=e87267a1a91149ffb8c5db7e4c35a24c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:48.890351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80da3d-f84f-4a87-9a45-f97ed8d61d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:48.892040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cf85e-6baf-4d91-a895-08313328c246 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7d80da3d-f84f-4a87-9a45-f97ed8d61d8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:48.901551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:48.903045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:48.904150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:43:48.904881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 87/171] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:48 2022] GET /identity/v3/users/e87267a1a91149ffb8c5db7e4c35a24c => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:48.906600 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 85/172] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:43:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:43:48.911213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cf85e-6baf-4d91-a895-08313328c246 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:48.912612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80da3d-f84f-4a87-9a45-f97ed8d61d8b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:49.044109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cf85e-6baf-4d91-a895-08313328c246 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:49.048559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80da3d-f84f-4a87-9a45-f97ed8d61d8b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:49.094086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30d094-a3a0-4ade-b50f-8f6fe532079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:49.096130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d094-a3a0-4ade-b50f-8f6fe532079d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.096745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d094-a3a0-4ade-b50f-8f6fe532079d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.097807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30d094-a3a0-4ade-b50f-8f6fe532079d None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.099563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30d094-a3a0-4ade-b50f-8f6fe532079d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:49.100418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30d094-a3a0-4ade-b50f-8f6fe532079d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:49.102516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30d094-a3a0-4ade-b50f-8f6fe532079d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:49.112195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542016fd-9ff6-4d06-9850-e7c5c6db6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:49.113129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542016fd-9ff6-4d06-9850-e7c5c6db6404 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.113565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542016fd-9ff6-4d06-9850-e7c5c6db6404 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.113987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542016fd-9ff6-4d06-9850-e7c5c6db6404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.118271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 86/173] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:43:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:49.126398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30d094-a3a0-4ade-b50f-8f6fe532079d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:49.156342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:49.205560 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:49.256388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542016fd-9ff6-4d06-9850-e7c5c6db6404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:49.258174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542016fd-9ff6-4d06-9850-e7c5c6db6404 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:49.294626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30d094-a3a0-4ade-b50f-8f6fe532079d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:49.369532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c47634-6257-467a-9d24-9fe2626a839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:49.370447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47634-6257-467a-9d24-9fe2626a839c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.370745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47634-6257-467a-9d24-9fe2626a839c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.371032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47634-6257-467a-9d24-9fe2626a839c None admin] PATH_INFO: `/v3/users/e87267a1a91149ffb8c5db7e4c35a24c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.376118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c47634-6257-467a-9d24-9fe2626a839c None admin] RBAC: Authorizing `identity:get_user(user_id=e87267a1a91149ffb8c5db7e4c35a24c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:49.377627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c47634-6257-467a-9d24-9fe2626a839c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:49.379449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 87/174] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:49 2022] GET /identity/v3/users/e87267a1a91149ffb8c5db7e4c35a24c => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:49.381077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2c8d1-6717-48a0-a2f1-834fa4aeb78c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.381525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2c8d1-6717-48a0-a2f1-834fa4aeb78c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.381952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2c8d1-6717-48a0-a2f1-834fa4aeb78c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.383521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 88/175] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:49.385590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfad75f-4f95-4923-a4fd-c6221f206b50 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.386218 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfad75f-4f95-4923-a4fd-c6221f206b50 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.386650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfad75f-4f95-4923-a4fd-c6221f206b50 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.388209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 89/176] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:49.389412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfad75f-4f95-4923-a4fd-c6221f206b50 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:49.441140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 88/177] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 15:43:49.442831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c23e9-4748-42cd-a166-1c74b0c071bd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.443312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c23e9-4748-42cd-a166-1c74b0c071bd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.443600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c23e9-4748-42cd-a166-1c74b0c071bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.467514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e11c23e9-4748-42cd-a166-1c74b0c071bd None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:49.470032 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e11c23e9-4748-42cd-a166-1c74b0c071bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:49.521684 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfad75f-4f95-4923-a4fd-c6221f206b50 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:49.523972 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:49.539582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:49.556014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 89/178] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:49.557949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21ad9-48b1-4ebc-9e70-31458b458187 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.558429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21ad9-48b1-4ebc-9e70-31458b458187 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.558709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21ad9-48b1-4ebc-9e70-31458b458187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.574889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1752715-3332-413d-ae5d-14fcc62c0183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:49.576039 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1752715-3332-413d-ae5d-14fcc62c0183 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.576461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1752715-3332-413d-ae5d-14fcc62c0183 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.576944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1752715-3332-413d-ae5d-14fcc62c0183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.579892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-09f21ad9-48b1-4ebc-9e70-31458b458187 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:49.581123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-09f21ad9-48b1-4ebc-9e70-31458b458187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:49.656318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 90/179] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:49.656609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21ad9-48b1-4ebc-9e70-31458b458187 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:49.668178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1752715-3332-413d-ae5d-14fcc62c0183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:49.669698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1752715-3332-413d-ae5d-14fcc62c0183 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:49.765349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21ad9-48b1-4ebc-9e70-31458b458187 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:49.773603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 90/180] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:49.778632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baebfe-9a9a-4572-918c-a5d9685e160a None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.778903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baebfe-9a9a-4572-918c-a5d9685e160a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.779219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baebfe-9a9a-4572-918c-a5d9685e160a None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.780570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 91/181] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:49.781278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baebfe-9a9a-4572-918c-a5d9685e160a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:49.784169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:49.784454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:49.803496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6f64d-f43d-4ddd-bd84-06682d1e50a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:49.804360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6f64d-f43d-4ddd-bd84-06682d1e50a6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.804643 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6f64d-f43d-4ddd-bd84-06682d1e50a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.804919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6f64d-f43d-4ddd-bd84-06682d1e50a6 None admin] PATH_INFO: `/v3/projects/81153851a37d4d1bb980a6b4efce47fa` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.806114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6f64d-f43d-4ddd-bd84-06682d1e50a6 None admin] RBAC: Authorizing `identity:get_project(project_id=81153851a37d4d1bb980a6b4efce47fa)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:49.807813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6f64d-f43d-4ddd-bd84-06682d1e50a6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:49.809541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 91/182] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:49 2022] GET /identity/v3/projects/81153851a37d4d1bb980a6b4efce47fa => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:49.810782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f160a-dc78-466c-ab83-f95aa4c4cf43 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.811083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f160a-dc78-466c-ab83-f95aa4c4cf43 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.811386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f160a-dc78-466c-ab83-f95aa4c4cf43 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.812769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 92/183] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:49.813382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f160a-dc78-466c-ab83-f95aa4c4cf43 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:49.892548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baebfe-9a9a-4572-918c-a5d9685e160a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:49.917888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f160a-dc78-466c-ab83-f95aa4c4cf43 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:49.927456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936615b-c8d6-461f-9995-7e6ac7cd4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:49.928279 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936615b-c8d6-461f-9995-7e6ac7cd4d5e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.928574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936615b-c8d6-461f-9995-7e6ac7cd4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.928857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936615b-c8d6-461f-9995-7e6ac7cd4d5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.942645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936615b-c8d6-461f-9995-7e6ac7cd4d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-c936615b-c8d6-461f-9995-7e6ac7cd4d5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:49.951638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:49.952521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 92/184] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:43:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:49.953801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936615b-c8d6-461f-9995-7e6ac7cd4d5e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:49.959150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67f226-583a-4a0d-8ce1-4934b598bf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:49.959986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67f226-583a-4a0d-8ce1-4934b598bf99 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.960274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67f226-583a-4a0d-8ce1-4934b598bf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.960553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67f226-583a-4a0d-8ce1-4934b598bf99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.961729 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67f226-583a-4a0d-8ce1-4934b598bf99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:49.964121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67f226-583a-4a0d-8ce1-4934b598bf99 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:49.965751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 93/185] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:49.965751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83aeaa-ba47-450c-9950-0cbb5bdecdd0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:49.965751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83aeaa-ba47-450c-9950-0cbb5bdecdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:49.965751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83aeaa-ba47-450c-9950-0cbb5bdecdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:49.984468 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4e83aeaa-ba47-450c-9950-0cbb5bdecdd0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:49.985679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4e83aeaa-ba47-450c-9950-0cbb5bdecdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:50.020432 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:50.036452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:50.054343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 94/186] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:50.055403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83aeaa-ba47-450c-9950-0cbb5bdecdd0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:50.076847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936615b-c8d6-461f-9995-7e6ac7cd4d5e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:50.113725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6182178-342a-49cf-8181-a486aeebbba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:50.114618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182178-342a-49cf-8181-a486aeebbba6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:50.114905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182178-342a-49cf-8181-a486aeebbba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:50.115227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182178-342a-49cf-8181-a486aeebbba6 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:50.116417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6182178-342a-49cf-8181-a486aeebbba6 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:50.117883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6182178-342a-49cf-8181-a486aeebbba6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:50.120283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 93/187] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:49 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:50.124409 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936e822-a1fb-49d0-8293-b3d2d8f1a619 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:50.124874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936e822-a1fb-49d0-8293-b3d2d8f1a619 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:50.125163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936e822-a1fb-49d0-8293-b3d2d8f1a619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:50.146143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4936e822-a1fb-49d0-8293-b3d2d8f1a619 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:50.147411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4936e822-a1fb-49d0-8293-b3d2d8f1a619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:50.164113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83aeaa-ba47-450c-9950-0cbb5bdecdd0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:50.199451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4c384-0c4e-4a47-abd4-ee237a3f0e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:50.200129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4c384-0c4e-4a47-abd4-ee237a3f0e01 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:50.200403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4c384-0c4e-4a47-abd4-ee237a3f0e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:50.200691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4c384-0c4e-4a47-abd4-ee237a3f0e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:50.201532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4c384-0c4e-4a47-abd4-ee237a3f0e01 None admin] RBAC: Adding query filter params (role.id=c78e303f11a84bcd80e78de27d7d26f2, scope.project.id=81153851a37d4d1bb980a6b4efce47fa, user.id=e87267a1a91149ffb8c5db7e4c35a24c) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:50.201850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4c384-0c4e-4a47-abd4-ee237a3f0e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:50.203319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4c384-0c4e-4a47-abd4-ee237a3f0e01 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:50.218808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 95/188] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:50 2022] GET /identity/v3/role_assignments?user.id=e87267a1a91149ffb8c5db7e4c35a24c&scope.project.id=81153851a37d4d1bb980a6b4efce47fa&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:50.218808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4c384-0c4e-4a47-abd4-ee237a3f0e01 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:50.221822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 94/189] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:50.222888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936e822-a1fb-49d0-8293-b3d2d8f1a619 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:50.273584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:50.308055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:50.335000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4c384-0c4e-4a47-abd4-ee237a3f0e01 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:50.361563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936e822-a1fb-49d0-8293-b3d2d8f1a619 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:50.375430 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e283c-3b80-48f4-9592-483e65908a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:50.376119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e283c-3b80-48f4-9592-483e65908a2f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:50.376407 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e283c-3b80-48f4-9592-483e65908a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:50.376687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e283c-3b80-48f4-9592-483e65908a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:50.377454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e283c-3b80-48f4-9592-483e65908a2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:50.377766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e283c-3b80-48f4-9592-483e65908a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:50.379186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e283c-3b80-48f4-9592-483e65908a2f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:50.390326 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 96/190] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:43:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:50.395758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e283c-3b80-48f4-9592-483e65908a2f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:50.417746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48aa09-5c60-4c5a-8958-e47c7f182b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:50.418433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48aa09-5c60-4c5a-8958-e47c7f182b46 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:50.418721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48aa09-5c60-4c5a-8958-e47c7f182b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:50.418998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48aa09-5c60-4c5a-8958-e47c7f182b46 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:50.419783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48aa09-5c60-4c5a-8958-e47c7f182b46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:50.421245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48aa09-5c60-4c5a-8958-e47c7f182b46 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:50.444241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 95/191] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:43:50 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:43:50.445041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48aa09-5c60-4c5a-8958-e47c7f182b46 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:50.523239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e283c-3b80-48f4-9592-483e65908a2f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:50.535800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:50.563534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d213b2-c079-432a-b4e5-1eb1616f8d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:50.564489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d213b2-c079-432a-b4e5-1eb1616f8d84 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:50.564656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d213b2-c079-432a-b4e5-1eb1616f8d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:50.564941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d213b2-c079-432a-b4e5-1eb1616f8d84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:50.568807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48aa09-5c60-4c5a-8958-e47c7f182b46 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:50.578039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d213b2-c079-432a-b4e5-1eb1616f8d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e5d213b2-c079-432a-b4e5-1eb1616f8d84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:50.586111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:50.587066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:50.588149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 97/192] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:50.589401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d213b2-c079-432a-b4e5-1eb1616f8d84 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:50.595201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:50.624203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc25bf-987f-4a78-a78b-d1e9516c2fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:50.624523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc25bf-987f-4a78-a78b-d1e9516c2fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:50.627275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc25bf-987f-4a78-a78b-d1e9516c2fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:50.627275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc25bf-987f-4a78-a78b-d1e9516c2fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:50.627275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc25bf-987f-4a78-a78b-d1e9516c2fa0 None admin] RBAC: Adding query filter params (role.id=8bd0b3ec424b423da0670486cc02bc49, scope.project.id=21ac6b9f65304534adce7421674442c6, user.id=e87267a1a91149ffb8c5db7e4c35a24c) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:50.627275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc25bf-987f-4a78-a78b-d1e9516c2fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:50.627728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc25bf-987f-4a78-a78b-d1e9516c2fa0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:50.634285 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 96/193] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:50 2022] GET /identity/v3/role_assignments?user.id=e87267a1a91149ffb8c5db7e4c35a24c&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=8bd0b3ec424b423da0670486cc02bc49 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:50.636674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc25bf-987f-4a78-a78b-d1e9516c2fa0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:50.731072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d213b2-c079-432a-b4e5-1eb1616f8d84 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:50.778568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc25bf-987f-4a78-a78b-d1e9516c2fa0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:50.779375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382f49f-29a3-4924-863c-edac28957249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:50.780462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382f49f-29a3-4924-863c-edac28957249 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:50.780957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382f49f-29a3-4924-863c-edac28957249 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:50.781427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382f49f-29a3-4924-863c-edac28957249 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:50.795816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382f49f-29a3-4924-863c-edac28957249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b382f49f-29a3-4924-863c-edac28957249 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:50.804922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:50.805865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:43:50.806760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:50.811224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 98/194] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:50.811224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382f49f-29a3-4924-863c-edac28957249 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:50.835201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3d975-4fbf-4f4c-a463-5d70467701b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:50.836100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3d975-4fbf-4f4c-a463-5d70467701b5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:50.836391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3d975-4fbf-4f4c-a463-5d70467701b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:50.836675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3d975-4fbf-4f4c-a463-5d70467701b5 None admin] PATH_INFO: `/v3/users/48da884ff0ad44c6bb58f38eb43064fe` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:50.850316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:50.859805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3d975-4fbf-4f4c-a463-5d70467701b5 None admin] RBAC: Authorizing `identity:get_user(user_id=48da884ff0ad44c6bb58f38eb43064fe)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:50.861313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3d975-4fbf-4f4c-a463-5d70467701b5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:50.863258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 97/195] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:50 2022] GET /identity/v3/users/48da884ff0ad44c6bb58f38eb43064fe => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:50.864100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3d975-4fbf-4f4c-a463-5d70467701b5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:50.923562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:50.955565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382f49f-29a3-4924-863c-edac28957249 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:50.999580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4fd7f-8e7f-4e97-8f98-b4a154677d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:51.000547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4fd7f-8e7f-4e97-8f98-b4a154677d41 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:51.000980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4fd7f-8e7f-4e97-8f98-b4a154677d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:51.001405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4fd7f-8e7f-4e97-8f98-b4a154677d41 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:51.002494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4fd7f-8e7f-4e97-8f98-b4a154677d41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:51.003037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4fd7f-8e7f-4e97-8f98-b4a154677d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:51.004510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3d975-4fbf-4f4c-a463-5d70467701b5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:51.005132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4fd7f-8e7f-4e97-8f98-b4a154677d41 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:51.017516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 99/196] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:51.018794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4fd7f-8e7f-4e97-8f98-b4a154677d41 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:51.045966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe72dd-bd12-45e4-8a30-adf8ad013f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:51.046575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe72dd-bd12-45e4-8a30-adf8ad013f92 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:51.046867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe72dd-bd12-45e4-8a30-adf8ad013f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:51.047764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe72dd-bd12-45e4-8a30-adf8ad013f92 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:51.048555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe72dd-bd12-45e4-8a30-adf8ad013f92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:51.049195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe72dd-bd12-45e4-8a30-adf8ad013f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:51.050786 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe72dd-bd12-45e4-8a30-adf8ad013f92 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:51.068901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 98/197] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:51.069843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe72dd-bd12-45e4-8a30-adf8ad013f92 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:51.145926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:51.158819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4fd7f-8e7f-4e97-8f98-b4a154677d41 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:51.200225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791c792-587a-46bb-9f75-3c2fb5f8851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:51.201139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791c792-587a-46bb-9f75-3c2fb5f8851a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:51.201434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791c792-587a-46bb-9f75-3c2fb5f8851a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:51.201734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791c792-587a-46bb-9f75-3c2fb5f8851a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:51.202354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:51.206082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe72dd-bd12-45e4-8a30-adf8ad013f92 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:51.245316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645889-b7d4-40d9-864b-1f493b9b83d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:51.246205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645889-b7d4-40d9-864b-1f493b9b83d1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:51.246492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645889-b7d4-40d9-864b-1f493b9b83d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:51.246822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645889-b7d4-40d9-864b-1f493b9b83d1 None admin] PATH_INFO: `/v3/users/48da884ff0ad44c6bb58f38eb43064fe` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:51.248183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645889-b7d4-40d9-864b-1f493b9b83d1 None admin] RBAC: Authorizing `identity:get_user(user_id=48da884ff0ad44c6bb58f38eb43064fe)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:51.249638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645889-b7d4-40d9-864b-1f493b9b83d1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:51.255809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 99/198] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:51 2022] GET /identity/v3/users/48da884ff0ad44c6bb58f38eb43064fe => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:51.256671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645889-b7d4-40d9-864b-1f493b9b83d1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:51.306393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791c792-587a-46bb-9f75-3c2fb5f8851a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:51.308027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791c792-587a-46bb-9f75-3c2fb5f8851a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:51.379097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645889-b7d4-40d9-864b-1f493b9b83d1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:51.421222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22dc2b-99ac-45a8-8e29-9a2a354f706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:51.422431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:51.425591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22dc2b-99ac-45a8-8e29-9a2a354f706a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:51.427309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22dc2b-99ac-45a8-8e29-9a2a354f706a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:51.428688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22dc2b-99ac-45a8-8e29-9a2a354f706a None admin] PATH_INFO: `/v3/users/196de2cd9123446394cdfdf1e0a1325a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:51.432325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22dc2b-99ac-45a8-8e29-9a2a354f706a None admin] RBAC: Authorizing `identity:get_user(user_id=196de2cd9123446394cdfdf1e0a1325a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:51.435236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22dc2b-99ac-45a8-8e29-9a2a354f706a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:51.442174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 100/199] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:51.442174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791c792-587a-46bb-9f75-3c2fb5f8851a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:51.442488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 100/200] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:51 2022] GET /identity/v3/users/196de2cd9123446394cdfdf1e0a1325a => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:51.445503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22dc2b-99ac-45a8-8e29-9a2a354f706a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:51.499802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:51.570752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791c792-587a-46bb-9f75-3c2fb5f8851a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:51.590244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22dc2b-99ac-45a8-8e29-9a2a354f706a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:51.610259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4f8c-a208-4089-8635-af450dd1770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:51.610917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4f8c-a208-4089-8635-af450dd1770c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:51.611237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4f8c-a208-4089-8635-af450dd1770c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:51.611519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4f8c-a208-4089-8635-af450dd1770c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:51.639723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85705264-5ed4-45cb-9c1e-17e5fb5db5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:51.641615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705264-5ed4-45cb-9c1e-17e5fb5db5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:51.642372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705264-5ed4-45cb-9c1e-17e5fb5db5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:51.642856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705264-5ed4-45cb-9c1e-17e5fb5db5c9 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:51.645118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85705264-5ed4-45cb-9c1e-17e5fb5db5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:51.647604 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85705264-5ed4-45cb-9c1e-17e5fb5db5c9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:51.650018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 101/201] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:51 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:51.651534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85705264-5ed4-45cb-9c1e-17e5fb5db5c9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:51.684031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:51.697680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4f8c-a208-4089-8635-af450dd1770c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:51.699442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4f8c-a208-4089-8635-af450dd1770c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:51.800352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85705264-5ed4-45cb-9c1e-17e5fb5db5c9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:51.804496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:51.813495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 101/202] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:51.819474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4f8c-a208-4089-8635-af450dd1770c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:51.846610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef822354-b9fc-4d50-bcf0-eb443ede66f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:51.847327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef822354-b9fc-4d50-bcf0-eb443ede66f3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:51.847623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef822354-b9fc-4d50-bcf0-eb443ede66f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:51.848043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef822354-b9fc-4d50-bcf0-eb443ede66f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:51.938199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:51.948497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef822354-b9fc-4d50-bcf0-eb443ede66f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:51.949149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4f8c-a208-4089-8635-af450dd1770c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:51.950002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef822354-b9fc-4d50-bcf0-eb443ede66f3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:51.986856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b0810-638b-4297-ac9e-28d3a7322ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:51.987916 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0810-638b-4297-ac9e-28d3a7322ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:51.988409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0810-638b-4297-ac9e-28d3a7322ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:51.988946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0810-638b-4297-ac9e-28d3a7322ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:51.990079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b0810-638b-4297-ac9e-28d3a7322ec2 None admin] RBAC: Adding query filter params (role.id=8bd0b3ec424b423da0670486cc02bc49, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f, user.id=48da884ff0ad44c6bb58f38eb43064fe) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:51.990616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b0810-638b-4297-ac9e-28d3a7322ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:51.992347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b0810-638b-4297-ac9e-28d3a7322ec2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:51.999279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 102/203] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:51 2022] GET /identity/v3/role_assignments?user.id=48da884ff0ad44c6bb58f38eb43064fe&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=8bd0b3ec424b423da0670486cc02bc49 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:52.000494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b0810-638b-4297-ac9e-28d3a7322ec2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:52.072247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 102/204] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:52.080333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef822354-b9fc-4d50-bcf0-eb443ede66f3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:52.084062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:52.127718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b0810-638b-4297-ac9e-28d3a7322ec2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:52.172083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aef2e-c449-4c12-8dca-7ed49e97c462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:52.172972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aef2e-c449-4c12-8dca-7ed49e97c462 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:52.173262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aef2e-c449-4c12-8dca-7ed49e97c462 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:52.173799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aef2e-c449-4c12-8dca-7ed49e97c462 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:52.175090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aef2e-c449-4c12-8dca-7ed49e97c462 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:52.176794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aef2e-c449-4c12-8dca-7ed49e97c462 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:52.179011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 103/205] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:51 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:52.191055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aef2e-c449-4c12-8dca-7ed49e97c462 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:52.241158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:52.283102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef822354-b9fc-4d50-bcf0-eb443ede66f3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:52.348998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88cc3d-8aa7-4b2a-8fc3-b67e86e09ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:52.349894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88cc3d-8aa7-4b2a-8fc3-b67e86e09ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:52.350192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88cc3d-8aa7-4b2a-8fc3-b67e86e09ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:52.350480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88cc3d-8aa7-4b2a-8fc3-b67e86e09ce3 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:52.352533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88cc3d-8aa7-4b2a-8fc3-b67e86e09ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:52.354750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88cc3d-8aa7-4b2a-8fc3-b67e86e09ce3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:52.365539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 103/206] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:52 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:52.368922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88cc3d-8aa7-4b2a-8fc3-b67e86e09ce3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:52.385741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aef2e-c449-4c12-8dca-7ed49e97c462 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:52.450945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8748f-0e3a-4fca-844a-50b16f7cc0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:52.451688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8748f-0e3a-4fca-844a-50b16f7cc0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:52.451985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8748f-0e3a-4fca-844a-50b16f7cc0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:52.452270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8748f-0e3a-4fca-844a-50b16f7cc0a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:52.453128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8748f-0e3a-4fca-844a-50b16f7cc0a7 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f, user.id=48da884ff0ad44c6bb58f38eb43064fe) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:52.453447 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8748f-0e3a-4fca-844a-50b16f7cc0a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:52.454920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8748f-0e3a-4fca-844a-50b16f7cc0a7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:52.476564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 104/207] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:52 2022] GET /identity/v3/role_assignments?user.id=48da884ff0ad44c6bb58f38eb43064fe&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=29dae918965d40bea71d83ffa2085316 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:52.503575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:52.542439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88cc3d-8aa7-4b2a-8fc3-b67e86e09ce3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:52.610053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff371e0-e20e-4b5d-aae1-ebfbccaa6c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:52.610745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff371e0-e20e-4b5d-aae1-ebfbccaa6c45 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:52.611035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff371e0-e20e-4b5d-aae1-ebfbccaa6c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:52.611348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff371e0-e20e-4b5d-aae1-ebfbccaa6c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:52.612225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff371e0-e20e-4b5d-aae1-ebfbccaa6c45 None admin] RBAC: Adding query filter params (role.id=5a49025933754ca3a061316bbeafb7e3, scope.project.id=21ac6b9f65304534adce7421674442c6, user.id=196de2cd9123446394cdfdf1e0a1325a) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:52.612547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff371e0-e20e-4b5d-aae1-ebfbccaa6c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:52.614028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff371e0-e20e-4b5d-aae1-ebfbccaa6c45 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:52.625774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 104/208] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:52 2022] GET /identity/v3/role_assignments?user.id=196de2cd9123446394cdfdf1e0a1325a&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=5a49025933754ca3a061316bbeafb7e3 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:52.926974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c05683-d465-498b-958b-cda8633616a4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:52.927375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c05683-d465-498b-958b-cda8633616a4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:52.927611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c05683-d465-498b-958b-cda8633616a4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:52.929284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 105/209] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:52.935517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40055510-7078-4f17-8771-fb6b8b4427b6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:52.936196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40055510-7078-4f17-8771-fb6b8b4427b6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:52.936196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40055510-7078-4f17-8771-fb6b8b4427b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:52.955305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-40055510-7078-4f17-8771-fb6b8b4427b6 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:52.956540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-40055510-7078-4f17-8771-fb6b8b4427b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:53.034599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 105/210] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:53.059941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c05683-d465-498b-958b-cda8633616a4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:53.093834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3965-9eb4-42e0-82fe-27a925595451 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:53.094355 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3965-9eb4-42e0-82fe-27a925595451 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:53.094562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3965-9eb4-42e0-82fe-27a925595451 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:53.095934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 106/211] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:53.101833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc968e-1210-4008-95c3-a665199ed7cc None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:53.102101 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc968e-1210-4008-95c3-a665199ed7cc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:53.102394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc968e-1210-4008-95c3-a665199ed7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:53.124995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-05cc968e-1210-4008-95c3-a665199ed7cc None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:53.126366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-05cc968e-1210-4008-95c3-a665199ed7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:53.180466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:53.195375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c05683-d465-498b-958b-cda8633616a4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:53.207893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:53.218455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 107/212] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:43:53.248126 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1c4a6-c99f-43b1-bee2-93231f115679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:53.249547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1c4a6-c99f-43b1-bee2-93231f115679 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:53.249990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1c4a6-c99f-43b1-bee2-93231f115679 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:53.250408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1c4a6-c99f-43b1-bee2-93231f115679 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:53.250701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc968e-1210-4008-95c3-a665199ed7cc None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:53.263098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1c4a6-c99f-43b1-bee2-93231f115679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-90c1c4a6-c99f-43b1-bee2-93231f115679 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:53.271572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:53.272614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:53.273588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:53.276767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 106/213] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:53.283655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1c4a6-c99f-43b1-bee2-93231f115679 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:53.392308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc968e-1210-4008-95c3-a665199ed7cc None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:53.405500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1c4a6-c99f-43b1-bee2-93231f115679 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:53.438778 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f164373-a66b-4c64-be19-3b24dd76fd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:53.440234 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f164373-a66b-4c64-be19-3b24dd76fd4e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:53.440601 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f164373-a66b-4c64-be19-3b24dd76fd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:53.440975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f164373-a66b-4c64-be19-3b24dd76fd4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:53.442483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f164373-a66b-4c64-be19-3b24dd76fd4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:53.444050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f164373-a66b-4c64-be19-3b24dd76fd4e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:53.445553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06119561-9f18-4d90-a8ce-6aa042317e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:53.445830 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 108/214] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:53.446659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06119561-9f18-4d90-a8ce-6aa042317e75 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:53.448609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06119561-9f18-4d90-a8ce-6aa042317e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:53.449078 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06119561-9f18-4d90-a8ce-6aa042317e75 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:53.450057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06119561-9f18-4d90-a8ce-6aa042317e75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:53.450529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06119561-9f18-4d90-a8ce-6aa042317e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:53.451996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f164373-a66b-4c64-be19-3b24dd76fd4e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:53.452537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06119561-9f18-4d90-a8ce-6aa042317e75 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:53.462184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 107/215] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:53.468362 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06119561-9f18-4d90-a8ce-6aa042317e75 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:53.486352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:53.545322 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:53.586755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f164373-a66b-4c64-be19-3b24dd76fd4e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:53.608416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06119561-9f18-4d90-a8ce-6aa042317e75 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:53.627649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9333ba-f78e-45ab-b7d4-6f279fff2047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:53.628275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9333ba-f78e-45ab-b7d4-6f279fff2047 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:53.628660 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9333ba-f78e-45ab-b7d4-6f279fff2047 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:53.628972 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9333ba-f78e-45ab-b7d4-6f279fff2047 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:53.629690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9333ba-f78e-45ab-b7d4-6f279fff2047 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:53.631333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9333ba-f78e-45ab-b7d4-6f279fff2047 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:53.654010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a5d60-294e-47e4-8e41-e7d6ec36ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:53.655283 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a5d60-294e-47e4-8e41-e7d6ec36ce22 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:53.655775 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a5d60-294e-47e4-8e41-e7d6ec36ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:53.656350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a5d60-294e-47e4-8e41-e7d6ec36ce22 None admin] PATH_INFO: `/v3/users/036501f15e5e4039ab171a991ca611eb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:53.656653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 109/216] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:43:53 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:43:53.675754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a5d60-294e-47e4-8e41-e7d6ec36ce22 None admin] RBAC: Authorizing `identity:get_user(user_id=036501f15e5e4039ab171a991ca611eb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:53.677620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a5d60-294e-47e4-8e41-e7d6ec36ce22 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:53.679778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 108/217] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:53 2022] GET /identity/v3/users/036501f15e5e4039ab171a991ca611eb => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:53.688336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9333ba-f78e-45ab-b7d4-6f279fff2047 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:53.811389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9333ba-f78e-45ab-b7d4-6f279fff2047 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:53.836456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:53.859354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312bdcf-64e2-4953-b8f0-89102637c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:53.860029 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312bdcf-64e2-4953-b8f0-89102637c511 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:53.860319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312bdcf-64e2-4953-b8f0-89102637c511 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:53.860599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312bdcf-64e2-4953-b8f0-89102637c511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:53.943565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312bdcf-64e2-4953-b8f0-89102637c511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:53.945103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312bdcf-64e2-4953-b8f0-89102637c511 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:54.059364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 110/218] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:54.065220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a5d60-294e-47e4-8e41-e7d6ec36ce22 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:54.137732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:54.176909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a5d60-294e-47e4-8e41-e7d6ec36ce22 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:54.214470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8346fce-edd7-46d4-b31e-2caaffa27f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:54.215671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8346fce-edd7-46d4-b31e-2caaffa27f3f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:54.216233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8346fce-edd7-46d4-b31e-2caaffa27f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:54.216695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8346fce-edd7-46d4-b31e-2caaffa27f3f None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:54.218158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8346fce-edd7-46d4-b31e-2caaffa27f3f None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:54.220002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8346fce-edd7-46d4-b31e-2caaffa27f3f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:54.221987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 109/219] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:54 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:54.228022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312bdcf-64e2-4953-b8f0-89102637c511 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:54.251626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:54.359710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312bdcf-64e2-4953-b8f0-89102637c511 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:54.407415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28563d93-4c36-4a61-8e98-1ee6685b4b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:54.408096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28563d93-4c36-4a61-8e98-1ee6685b4b49 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:54.408390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28563d93-4c36-4a61-8e98-1ee6685b4b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:54.408673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28563d93-4c36-4a61-8e98-1ee6685b4b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:54.409531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28563d93-4c36-4a61-8e98-1ee6685b4b49 None admin] RBAC: Adding query filter params (role.id=c78e303f11a84bcd80e78de27d7d26f2, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f, user.id=036501f15e5e4039ab171a991ca611eb) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:54.409850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28563d93-4c36-4a61-8e98-1ee6685b4b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:54.411346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28563d93-4c36-4a61-8e98-1ee6685b4b49 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:54.418243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 111/220] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:54 2022] GET /identity/v3/role_assignments?user.id=036501f15e5e4039ab171a991ca611eb&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:54.423554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665a8ce-24de-4128-aae3-442ecc33e014 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:54.424510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665a8ce-24de-4128-aae3-442ecc33e014 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:54.425001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665a8ce-24de-4128-aae3-442ecc33e014 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:54.426717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 110/221] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:54.433412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3996-4b5a-4799-ba81-58c214989290 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:54.433725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3996-4b5a-4799-ba81-58c214989290 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:54.433980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc3996-4b5a-4799-ba81-58c214989290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:54.460418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e7bc3996-4b5a-4799-ba81-58c214989290 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:54.461667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e7bc3996-4b5a-4799-ba81-58c214989290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:54.569489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 112/222] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:54.611427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665a8ce-24de-4128-aae3-442ecc33e014 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:54.751841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665a8ce-24de-4128-aae3-442ecc33e014 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:54.798290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90020b31-e337-4682-bc76-3ecbf7fe29ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:54.799515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90020b31-e337-4682-bc76-3ecbf7fe29ab None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:54.800032 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90020b31-e337-4682-bc76-3ecbf7fe29ab None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:54.800507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90020b31-e337-4682-bc76-3ecbf7fe29ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:54.805107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:54.814749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90020b31-e337-4682-bc76-3ecbf7fe29ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-90020b31-e337-4682-bc76-3ecbf7fe29ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:54.824138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:54.825150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:54.826371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 111/223] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:43:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:54.831757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc3996-4b5a-4799-ba81-58c214989290 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:54.860373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:54.909178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33235142-4c84-4887-bfa1-ca226d28ac98 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:54.909482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33235142-4c84-4887-bfa1-ca226d28ac98 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:54.909771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33235142-4c84-4887-bfa1-ca226d28ac98 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:54.911800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 112/224] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:54.918472 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4591cc2-0700-4ed6-be3a-20677037f92c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:54.918768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4591cc2-0700-4ed6-be3a-20677037f92c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:54.919052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4591cc2-0700-4ed6-be3a-20677037f92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:54.951251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a4591cc2-0700-4ed6-be3a-20677037f92c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:54.952746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a4591cc2-0700-4ed6-be3a-20677037f92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:55.023554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc3996-4b5a-4799-ba81-58c214989290 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:55.062988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfec0f-fdc6-455c-b9a2-3e884ab85977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:55.063696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfec0f-fdc6-455c-b9a2-3e884ab85977 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:55.063982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfec0f-fdc6-455c-b9a2-3e884ab85977 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:55.064258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfec0f-fdc6-455c-b9a2-3e884ab85977 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:55.065012 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfec0f-fdc6-455c-b9a2-3e884ab85977 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:55.065320 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfec0f-fdc6-455c-b9a2-3e884ab85977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:55.066700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfec0f-fdc6-455c-b9a2-3e884ab85977 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:55.075588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 113/225] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:43:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:55.081167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfec0f-fdc6-455c-b9a2-3e884ab85977 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:55.081307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 113/226] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:43:55.121235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4591cc2-0700-4ed6-be3a-20677037f92c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:55.164958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:55.191421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfec0f-fdc6-455c-b9a2-3e884ab85977 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:55.228582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0c4f8-2ccb-429a-86d8-c521cd04920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:55.229474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0c4f8-2ccb-429a-86d8-c521cd04920e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:55.229769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0c4f8-2ccb-429a-86d8-c521cd04920e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:55.230050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0c4f8-2ccb-429a-86d8-c521cd04920e None admin] PATH_INFO: `/v3/users/48da884ff0ad44c6bb58f38eb43064fe` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:55.231332 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0c4f8-2ccb-429a-86d8-c521cd04920e None admin] RBAC: Authorizing `identity:get_user(user_id=48da884ff0ad44c6bb58f38eb43064fe)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:55.232984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0c4f8-2ccb-429a-86d8-c521cd04920e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:55.234663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 114/227] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:55 2022] GET /identity/v3/users/48da884ff0ad44c6bb58f38eb43064fe => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:55.239989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0c4f8-2ccb-429a-86d8-c521cd04920e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:55.349669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0c4f8-2ccb-429a-86d8-c521cd04920e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:55.355485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4591cc2-0700-4ed6-be3a-20677037f92c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:55.398582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:55.405575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b23738-c8d2-40c7-bde9-d60ac5a06551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:55.406618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23738-c8d2-40c7-bde9-d60ac5a06551 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:55.406942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23738-c8d2-40c7-bde9-d60ac5a06551 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:55.408505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23738-c8d2-40c7-bde9-d60ac5a06551 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:55.410382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b23738-c8d2-40c7-bde9-d60ac5a06551 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:55.411879 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b23738-c8d2-40c7-bde9-d60ac5a06551 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:55.414428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 115/228] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:55 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:55.420566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b23738-c8d2-40c7-bde9-d60ac5a06551 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:55.426991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea8c6d-fef0-4022-a679-0d47df4541e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:55.427830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8c6d-fef0-4022-a679-0d47df4541e1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:55.428119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8c6d-fef0-4022-a679-0d47df4541e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:55.428408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8c6d-fef0-4022-a679-0d47df4541e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:55.449899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:55.450404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea8c6d-fef0-4022-a679-0d47df4541e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-88ea8c6d-fef0-4022-a679-0d47df4541e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:55.466620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:55.467600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:55.468862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 114/229] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:43:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:43:55.475636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea8c6d-fef0-4022-a679-0d47df4541e1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:55.661769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea8c6d-fef0-4022-a679-0d47df4541e1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:55.665314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b23738-c8d2-40c7-bde9-d60ac5a06551 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:55.737736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6f0bd-f64c-4346-b711-87ab23a2b788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:55.738856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6f0bd-f64c-4346-b711-87ab23a2b788 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:55.739150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6f0bd-f64c-4346-b711-87ab23a2b788 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:55.739453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6f0bd-f64c-4346-b711-87ab23a2b788 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:55.740325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa633b47-263c-4382-bfd4-70a8f76b96f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:55.741222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa633b47-263c-4382-bfd4-70a8f76b96f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:55.741510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa633b47-263c-4382-bfd4-70a8f76b96f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:55.741793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa633b47-263c-4382-bfd4-70a8f76b96f7 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/users/48da884ff0ad44c6bb58f38eb43064fe/roles/8bd0b3ec424b423da0670486cc02bc49` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:55.742541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6f0bd-f64c-4346-b711-87ab23a2b788 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:55.742857 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6f0bd-f64c-4346-b711-87ab23a2b788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:55.744856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6f0bd-f64c-4346-b711-87ab23a2b788 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:55.748885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa633b47-263c-4382-bfd4-70a8f76b96f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fa16d1165e84f94bf8fc56809c2564f, user_id=48da884ff0ad44c6bb58f38eb43064fe, role_id=8bd0b3ec424b423da0670486cc02bc49)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:55.750349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa633b47-263c-4382-bfd4-70a8f76b96f7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:55.760797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 115/230] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:55.767543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6f0bd-f64c-4346-b711-87ab23a2b788 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:55.769465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 116/231] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:43:55 2022] PUT /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/users/48da884ff0ad44c6bb58f38eb43064fe/roles/8bd0b3ec424b423da0670486cc02bc49 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:43:55.847681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:55.934103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6f0bd-f64c-4346-b711-87ab23a2b788 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:56.009949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2fd8a-557c-4495-8328-4847232f8e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:56.010781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2fd8a-557c-4495-8328-4847232f8e62 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:56.011311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2fd8a-557c-4495-8328-4847232f8e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:56.011799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2fd8a-557c-4495-8328-4847232f8e62 None admin] PATH_INFO: `/v3/users/48da884ff0ad44c6bb58f38eb43064fe` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:56.013933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2fd8a-557c-4495-8328-4847232f8e62 None admin] RBAC: Authorizing `identity:get_user(user_id=48da884ff0ad44c6bb58f38eb43064fe)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:56.015457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2fd8a-557c-4495-8328-4847232f8e62 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:56.017249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 116/232] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:55 2022] GET /identity/v3/users/48da884ff0ad44c6bb58f38eb43064fe => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:56.023772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa633b47-263c-4382-bfd4-70a8f76b96f7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:56.114132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:56.148520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa633b47-263c-4382-bfd4-70a8f76b96f7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:56.188677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fc455-83e2-4cbb-95ff-b60011f146cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:56.189627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fc455-83e2-4cbb-95ff-b60011f146cb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:56.189927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fc455-83e2-4cbb-95ff-b60011f146cb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:56.190212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fc455-83e2-4cbb-95ff-b60011f146cb None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:56.191574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fc455-83e2-4cbb-95ff-b60011f146cb None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:56.193061 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fc455-83e2-4cbb-95ff-b60011f146cb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:56.195185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 117/233] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:56 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:56.201235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2fd8a-557c-4495-8328-4847232f8e62 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:56.383656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2fd8a-557c-4495-8328-4847232f8e62 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:56.407877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:56.439445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a569b-52c5-434e-9aa8-dba238a72e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:56.440359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a569b-52c5-434e-9aa8-dba238a72e4d None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:56.440652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a569b-52c5-434e-9aa8-dba238a72e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:56.440933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a569b-52c5-434e-9aa8-dba238a72e4d None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/users/48da884ff0ad44c6bb58f38eb43064fe/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:56.449419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a569b-52c5-434e-9aa8-dba238a72e4d None admin] RBAC: Authorizing `identity:create_grant(project_id=0fa16d1165e84f94bf8fc56809c2564f, user_id=48da884ff0ad44c6bb58f38eb43064fe, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:56.450951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a569b-52c5-434e-9aa8-dba238a72e4d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:56.471801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 117/234] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:43:56 2022] PUT /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/users/48da884ff0ad44c6bb58f38eb43064fe/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:43:56.479613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1e76-f1ae-4544-8e29-d208c884f0ed None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:56.480286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1e76-f1ae-4544-8e29-d208c884f0ed None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:56.480286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1e76-f1ae-4544-8e29-d208c884f0ed None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:56.481837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 118/235] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:56.492940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca0c0a-2849-4ad0-aac5-0f356ed4648f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:56.493278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca0c0a-2849-4ad0-aac5-0f356ed4648f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:56.493517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca0c0a-2849-4ad0-aac5-0f356ed4648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:56.522466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-33ca0c0a-2849-4ad0-aac5-0f356ed4648f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:56.523799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-33ca0c0a-2849-4ad0-aac5-0f356ed4648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:56.621952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 118/236] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:56.655781 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd1e76-f1ae-4544-8e29-d208c884f0ed None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:56.796701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd1e76-f1ae-4544-8e29-d208c884f0ed None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:56.843339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1d3d-3a34-4b11-9ae9-3b91debc58d4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:56.843992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1d3d-3a34-4b11-9ae9-3b91debc58d4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:56.844094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047fa6b-e010-4115-a7b4-66da8fc88913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:56.844605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1d3d-3a34-4b11-9ae9-3b91debc58d4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:56.845199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047fa6b-e010-4115-a7b4-66da8fc88913 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:56.845689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047fa6b-e010-4115-a7b4-66da8fc88913 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:56.846169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047fa6b-e010-4115-a7b4-66da8fc88913 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:56.846924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 119/237] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:43:56.852828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2815e-1c34-4656-8b80-95e5b6bca29f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:56.853274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2815e-1c34-4656-8b80-95e5b6bca29f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:56.853708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2815e-1c34-4656-8b80-95e5b6bca29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:56.872495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:56.883422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047fa6b-e010-4115-a7b4-66da8fc88913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:56.895826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cca2815e-1c34-4656-8b80-95e5b6bca29f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:56.900519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cca2815e-1c34-4656-8b80-95e5b6bca29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-5047fa6b-e010-4115-a7b4-66da8fc88913 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:56.903276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:56.904163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:43:56.904962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:43:56.908772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 119/238] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:56.914835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047fa6b-e010-4115-a7b4-66da8fc88913 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:57.016268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 120/239] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:57.018021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e741ca-5940-4e1e-8b92-67f2206efde5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:57.018540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e741ca-5940-4e1e-8b92-67f2206efde5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:57.019021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e741ca-5940-4e1e-8b92-67f2206efde5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:57.020854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 121/240] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:57.026837 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb97c-08a1-4d17-87bd-425e6d83d321 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:57.027458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb97c-08a1-4d17-87bd-425e6d83d321 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:57.028115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb97c-08a1-4d17-87bd-425e6d83d321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:57.055692 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-157eb97c-08a1-4d17-87bd-425e6d83d321 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:57.057442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-157eb97c-08a1-4d17-87bd-425e6d83d321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:57.089054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047fa6b-e010-4115-a7b4-66da8fc88913 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:57.096804 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:57.133693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbca85-9924-40ae-a51e-0c62e0bcb82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:57.135481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbca85-9924-40ae-a51e-0c62e0bcb82f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:57.136167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbca85-9924-40ae-a51e-0c62e0bcb82f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:57.136662 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbca85-9924-40ae-a51e-0c62e0bcb82f None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:57.137622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbca85-9924-40ae-a51e-0c62e0bcb82f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:57.138136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbca85-9924-40ae-a51e-0c62e0bcb82f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:57.140046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbca85-9924-40ae-a51e-0c62e0bcb82f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:57.149058 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 122/241] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:57.149707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eb97c-08a1-4d17-87bd-425e6d83d321 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:57.151394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 120/242] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:57.167397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbca85-9924-40ae-a51e-0c62e0bcb82f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:57.255015 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:57.286734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eb97c-08a1-4d17-87bd-425e6d83d321 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:57.306801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbca85-9924-40ae-a51e-0c62e0bcb82f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:57.336604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5030e71-a65c-4b6b-a6d2-74d347107dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:57.337781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5030e71-a65c-4b6b-a6d2-74d347107dce None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:57.338393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5030e71-a65c-4b6b-a6d2-74d347107dce None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:57.338718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5030e71-a65c-4b6b-a6d2-74d347107dce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:57.340141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5030e71-a65c-4b6b-a6d2-74d347107dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:57.342338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5030e71-a65c-4b6b-a6d2-74d347107dce None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:57.345247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7f513-097b-4a86-8cd3-1f387adec1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:57.346205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f513-097b-4a86-8cd3-1f387adec1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:57.346557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f513-097b-4a86-8cd3-1f387adec1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:57.346910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f513-097b-4a86-8cd3-1f387adec1e8 None admin] PATH_INFO: `/v3/users/6d62067a9a924ef79321c2c0a3de1f73` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:57.349035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 123/243] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:43:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:57.350001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5030e71-a65c-4b6b-a6d2-74d347107dce None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:57.365018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7f513-097b-4a86-8cd3-1f387adec1e8 None admin] RBAC: Authorizing `identity:get_user(user_id=6d62067a9a924ef79321c2c0a3de1f73)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:57.366631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7f513-097b-4a86-8cd3-1f387adec1e8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:57.368795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 121/244] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:57 2022] GET /identity/v3/users/6d62067a9a924ef79321c2c0a3de1f73 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:57.370214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7f513-097b-4a86-8cd3-1f387adec1e8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:57.447834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:57.481031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7f513-097b-4a86-8cd3-1f387adec1e8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:57.485991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5030e71-a65c-4b6b-a6d2-74d347107dce None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:57.506837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:57.523206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24765bf2-577e-48a1-a900-dc760c02be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:57.523972 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765bf2-577e-48a1-a900-dc760c02be2e None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:57.524323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765bf2-577e-48a1-a900-dc760c02be2e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:57.524687 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765bf2-577e-48a1-a900-dc760c02be2e None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:57.526093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24765bf2-577e-48a1-a900-dc760c02be2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:57.527688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24765bf2-577e-48a1-a900-dc760c02be2e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:57.531463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd439-8898-4ef1-be61-04f1791eacbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:57.532272 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd439-8898-4ef1-be61-04f1791eacbd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:57.532564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd439-8898-4ef1-be61-04f1791eacbd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:57.532850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd439-8898-4ef1-be61-04f1791eacbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:57.546164 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fd439-8898-4ef1-be61-04f1791eacbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:57.549473 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 122/245] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:43:57 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:43:57.550502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24765bf2-577e-48a1-a900-dc760c02be2e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-633fd439-8898-4ef1-be61-04f1791eacbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:57.565226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:57.567632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:43:57.569764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 124/246] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:57.580156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd439-8898-4ef1-be61-04f1791eacbd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:57.680079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24765bf2-577e-48a1-a900-dc760c02be2e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:57.719017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62fc4f-4f05-437c-a419-646e7defa8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:57.719644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62fc4f-4f05-437c-a419-646e7defa8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:57.719933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62fc4f-4f05-437c-a419-646e7defa8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:57.720212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62fc4f-4f05-437c-a419-646e7defa8a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:57.760583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:57.772653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:57.774252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd439-8898-4ef1-be61-04f1791eacbd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:57.801642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62fc4f-4f05-437c-a419-646e7defa8a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:57.803180 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62fc4f-4f05-437c-a419-646e7defa8a9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:57.856937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d164591-1669-4cb6-9a7e-7ab8fe2e5e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:57.858178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164591-1669-4cb6-9a7e-7ab8fe2e5e5e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:57.858694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164591-1669-4cb6-9a7e-7ab8fe2e5e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:57.859189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164591-1669-4cb6-9a7e-7ab8fe2e5e5e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:57.860189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d164591-1669-4cb6-9a7e-7ab8fe2e5e5e None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:57.860736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d164591-1669-4cb6-9a7e-7ab8fe2e5e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:57.862532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d164591-1669-4cb6-9a7e-7ab8fe2e5e5e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:57.878894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 125/247] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:43:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:57.885039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d164591-1669-4cb6-9a7e-7ab8fe2e5e5e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:57.926662 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 123/248] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:57.936931 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62fc4f-4f05-437c-a419-646e7defa8a9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:58.032237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d164591-1669-4cb6-9a7e-7ab8fe2e5e5e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:58.036430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:58.062224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62fc4f-4f05-437c-a419-646e7defa8a9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:58.070439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368d0cb-88aa-48b6-812d-e2bee044dc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:58.071359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368d0cb-88aa-48b6-812d-e2bee044dc41 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:58.071650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368d0cb-88aa-48b6-812d-e2bee044dc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:58.072906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368d0cb-88aa-48b6-812d-e2bee044dc41 None admin] PATH_INFO: `/v3/users/036501f15e5e4039ab171a991ca611eb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:58.075585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368d0cb-88aa-48b6-812d-e2bee044dc41 None admin] RBAC: Authorizing `identity:get_user(user_id=036501f15e5e4039ab171a991ca611eb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:58.076986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368d0cb-88aa-48b6-812d-e2bee044dc41 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:58.078983 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 126/249] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:57 2022] GET /identity/v3/users/036501f15e5e4039ab171a991ca611eb => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:58.084261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368d0cb-88aa-48b6-812d-e2bee044dc41 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:58.106696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053457-0019-4522-a316-fd2552037399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:58.107958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053457-0019-4522-a316-fd2552037399 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:58.108423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053457-0019-4522-a316-fd2552037399 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:58.108858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053457-0019-4522-a316-fd2552037399 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:58.110416 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08053457-0019-4522-a316-fd2552037399 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:58.112110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08053457-0019-4522-a316-fd2552037399 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:58.114107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 124/250] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:57 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:58.116684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:58.121761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053457-0019-4522-a316-fd2552037399 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:58.228231 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368d0cb-88aa-48b6-812d-e2bee044dc41 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:58.253137 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053457-0019-4522-a316-fd2552037399 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:58.275593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54820d45-be22-4acf-9c46-1154dfa5083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:58.275593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820d45-be22-4acf-9c46-1154dfa5083e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:58.275593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820d45-be22-4acf-9c46-1154dfa5083e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:58.275593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820d45-be22-4acf-9c46-1154dfa5083e None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:58.276995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54820d45-be22-4acf-9c46-1154dfa5083e None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:58.278481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54820d45-be22-4acf-9c46-1154dfa5083e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:58.280314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 127/251] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:58 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:58.286372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54820d45-be22-4acf-9c46-1154dfa5083e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:58.325570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156d3e9-440f-41c1-a950-7e008d534d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:58.326273 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156d3e9-440f-41c1-a950-7e008d534d22 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:58.326565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156d3e9-440f-41c1-a950-7e008d534d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:58.326849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156d3e9-440f-41c1-a950-7e008d534d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:58.328099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156d3e9-440f-41c1-a950-7e008d534d22 None admin] RBAC: Adding query filter params (role.id=5a49025933754ca3a061316bbeafb7e3, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f, user.id=6d62067a9a924ef79321c2c0a3de1f73) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:58.328099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156d3e9-440f-41c1-a950-7e008d534d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:58.329489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156d3e9-440f-41c1-a950-7e008d534d22 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:58.336295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 125/252] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:58 2022] GET /identity/v3/role_assignments?user.id=6d62067a9a924ef79321c2c0a3de1f73&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=5a49025933754ca3a061316bbeafb7e3 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:58.366293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e8ef3-337b-4cd0-a748-bea8ee1b69d9 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:58.366589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e8ef3-337b-4cd0-a748-bea8ee1b69d9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:58.366874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e8ef3-337b-4cd0-a748-bea8ee1b69d9 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:58.370306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 126/253] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:43:58.377618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819d53-b54d-4490-85a6-c2418d108472 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:58.377618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819d53-b54d-4490-85a6-c2418d108472 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:58.377883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819d53-b54d-4490-85a6-c2418d108472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:58.402679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e0819d53-b54d-4490-85a6-c2418d108472 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:58.403963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e0819d53-b54d-4490-85a6-c2418d108472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:58.407557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:58.421772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:58.434706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54820d45-be22-4acf-9c46-1154dfa5083e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:58.476082 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769596-d565-433d-9978-17ee79532114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:58.478050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769596-d565-433d-9978-17ee79532114 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:58.478516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769596-d565-433d-9978-17ee79532114 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:58.478967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769596-d565-433d-9978-17ee79532114 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/users/036501f15e5e4039ab171a991ca611eb/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:58.481616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd769596-d565-433d-9978-17ee79532114 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fa16d1165e84f94bf8fc56809c2564f, user_id=036501f15e5e4039ab171a991ca611eb, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:58.483373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd769596-d565-433d-9978-17ee79532114 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:58.491186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 127/254] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:43:58.502559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 128/255] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:43:58 2022] PUT /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/users/036501f15e5e4039ab171a991ca611eb/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:43:58.520932 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819d53-b54d-4490-85a6-c2418d108472 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:58.645225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819d53-b54d-4490-85a6-c2418d108472 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:58.684358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843640b-f92a-410f-8ed5-c63e5d31a3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:58.685206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843640b-f92a-410f-8ed5-c63e5d31a3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:58.685605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843640b-f92a-410f-8ed5-c63e5d31a3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:58.685893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843640b-f92a-410f-8ed5-c63e5d31a3e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:58.694285 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:58.698825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843640b-f92a-410f-8ed5-c63e5d31a3e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b843640b-f92a-410f-8ed5-c63e5d31a3e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:58.707670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:58.708626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:43:58.709437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:43:58.712217 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 128/256] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:43:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:58.718528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769596-d565-433d-9978-17ee79532114 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:58.835399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769596-d565-433d-9978-17ee79532114 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:58.873510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fa0f4-5fa3-43d9-aa16-8807ba5ee1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:58.874340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fa0f4-5fa3-43d9-aa16-8807ba5ee1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:58.874756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fa0f4-5fa3-43d9-aa16-8807ba5ee1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:58.875042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fa0f4-5fa3-43d9-aa16-8807ba5ee1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:58.875839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fa0f4-5fa3-43d9-aa16-8807ba5ee1a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:58.876156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fa0f4-5fa3-43d9-aa16-8807ba5ee1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:58.877573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fa0f4-5fa3-43d9-aa16-8807ba5ee1a7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:58.887786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 129/257] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:43:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:58.893609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843640b-f92a-410f-8ed5-c63e5d31a3e8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:59.060522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843640b-f92a-410f-8ed5-c63e5d31a3e8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:59.110649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f93d8-3f30-4bf9-8d55-303b2799a209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:59.111570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f93d8-3f30-4bf9-8d55-303b2799a209 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:59.111856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f93d8-3f30-4bf9-8d55-303b2799a209 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:59.112134 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f93d8-3f30-4bf9-8d55-303b2799a209 None admin] PATH_INFO: `/v3/users/48da884ff0ad44c6bb58f38eb43064fe` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:59.113390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f93d8-3f30-4bf9-8d55-303b2799a209 None admin] RBAC: Authorizing `identity:get_user(user_id=48da884ff0ad44c6bb58f38eb43064fe)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:59.114917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f93d8-3f30-4bf9-8d55-303b2799a209 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:59.116609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 129/258] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:58 2022] GET /identity/v3/users/48da884ff0ad44c6bb58f38eb43064fe => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:59.122757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fa0f4-5fa3-43d9-aa16-8807ba5ee1a7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:59.148041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550ca6f-1c1a-464c-93ae-7d979e58a7b2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:59.148345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550ca6f-1c1a-464c-93ae-7d979e58a7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:59.148620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550ca6f-1c1a-464c-93ae-7d979e58a7b2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:59.150982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 130/259] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:43:59.156106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1e05c-1a87-4440-baae-5e0efdb5ab2b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:59.156404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1e05c-1a87-4440-baae-5e0efdb5ab2b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:59.156693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1e05c-1a87-4440-baae-5e0efdb5ab2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:59.160299 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:59.200358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-cbb1e05c-1a87-4440-baae-5e0efdb5ab2b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:43:59.201519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cbb1e05c-1a87-4440-baae-5e0efdb5ab2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:43:59.308980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:59.325748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 131/260] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:43:59.335189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fa0f4-5fa3-43d9-aa16-8807ba5ee1a7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:59.366475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1e05c-1a87-4440-baae-5e0efdb5ab2b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:59.420648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13c65a-6da4-4162-9833-e718193e6577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:59.421319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13c65a-6da4-4162-9833-e718193e6577 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:59.421608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13c65a-6da4-4162-9833-e718193e6577 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:59.421887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13c65a-6da4-4162-9833-e718193e6577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:59.548266 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13c65a-6da4-4162-9833-e718193e6577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:59.550512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13c65a-6da4-4162-9833-e718193e6577 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:59.573706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:59.599087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1e05c-1a87-4440-baae-5e0efdb5ab2b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:59.676726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ddb2a-2553-4f6c-a0d7-78568f4509fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:59.679971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ddb2a-2553-4f6c-a0d7-78568f4509fa None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:59.680406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ddb2a-2553-4f6c-a0d7-78568f4509fa None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:59.680825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ddb2a-2553-4f6c-a0d7-78568f4509fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:59.702167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ddb2a-2553-4f6c-a0d7-78568f4509fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:43:59.713212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 130/261] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-552ddb2a-2553-4f6c-a0d7-78568f4509fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:43:59.713389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:43:59.714190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:43:59.714971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 132/262] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:43:59.719988 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13c65a-6da4-4162-9833-e718193e6577 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:59.734010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ddb2a-2553-4f6c-a0d7-78568f4509fa None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:59.827928 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:59.830704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13c65a-6da4-4162-9833-e718193e6577 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:59.856558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:43:59.881143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ddb2a-2553-4f6c-a0d7-78568f4509fa None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:43:59.893338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756c07e-74a0-4916-ba09-e1aacc5f9ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:59.894238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756c07e-74a0-4916-ba09-e1aacc5f9ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:59.894709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756c07e-74a0-4916-ba09-e1aacc5f9ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:59.894812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756c07e-74a0-4916-ba09-e1aacc5f9ea2 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:59.900509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756c07e-74a0-4916-ba09-e1aacc5f9ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:59.902075 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756c07e-74a0-4916-ba09-e1aacc5f9ea2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:59.904268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 131/263] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:43:59 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:43:59.910182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756c07e-74a0-4916-ba09-e1aacc5f9ea2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:43:59.921796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a64d29-28ed-439c-8da8-70a0f9c719ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:43:59.922879 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64d29-28ed-439c-8da8-70a0f9c719ae None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:43:59.923384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64d29-28ed-439c-8da8-70a0f9c719ae None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:43:59.923859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64d29-28ed-439c-8da8-70a0f9c719ae None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:43:59.924877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a64d29-28ed-439c-8da8-70a0f9c719ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:43:59.925378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a64d29-28ed-439c-8da8-70a0f9c719ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:43:59.927094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a64d29-28ed-439c-8da8-70a0f9c719ae None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:43:59.937960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 133/264] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:43:59.953247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a64d29-28ed-439c-8da8-70a0f9c719ae None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:00.038740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756c07e-74a0-4916-ba09-e1aacc5f9ea2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:00.120038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9dbca-d0e4-45d4-bddf-ad08f58c2fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:00.120641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9dbca-d0e4-45d4-bddf-ad08f58c2fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:00.120931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9dbca-d0e4-45d4-bddf-ad08f58c2fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:00.121209 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9dbca-d0e4-45d4-bddf-ad08f58c2fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:00.122132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9dbca-d0e4-45d4-bddf-ad08f58c2fb6 None admin] RBAC: Adding query filter params (role.id=8bd0b3ec424b423da0670486cc02bc49, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f, user.id=48da884ff0ad44c6bb58f38eb43064fe) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:00.122377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9dbca-d0e4-45d4-bddf-ad08f58c2fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:00.123885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9dbca-d0e4-45d4-bddf-ad08f58c2fb6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:00.135215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 132/265] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:43:59 2022] GET /identity/v3/role_assignments?user.id=48da884ff0ad44c6bb58f38eb43064fe&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=8bd0b3ec424b423da0670486cc02bc49 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:00.155969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a64d29-28ed-439c-8da8-70a0f9c719ae None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:00.181717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:00.207928 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f302ac-6965-49e9-8d2b-0182f6b549b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:00.209173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f302ac-6965-49e9-8d2b-0182f6b549b8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:00.209682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f302ac-6965-49e9-8d2b-0182f6b549b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:00.210181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f302ac-6965-49e9-8d2b-0182f6b549b8 None admin] PATH_INFO: `/v3/users/48da884ff0ad44c6bb58f38eb43064fe` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:00.211717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f302ac-6965-49e9-8d2b-0182f6b549b8 None admin] RBAC: Authorizing `identity:get_user(user_id=48da884ff0ad44c6bb58f38eb43064fe)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:00.214121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f302ac-6965-49e9-8d2b-0182f6b549b8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:00.216145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 134/266] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:43:59 2022] GET /identity/v3/users/48da884ff0ad44c6bb58f38eb43064fe => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:00.221782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9dbca-d0e4-45d4-bddf-ad08f58c2fb6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:00.298789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:00.366414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9dbca-d0e4-45d4-bddf-ad08f58c2fb6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:00.410197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0cee5-9d51-4f68-a043-8b3267a8fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:00.410870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0cee5-9d51-4f68-a043-8b3267a8fd8c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:00.411176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0cee5-9d51-4f68-a043-8b3267a8fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:00.411463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0cee5-9d51-4f68-a043-8b3267a8fd8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:00.492632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0cee5-9d51-4f68-a043-8b3267a8fd8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:00.494717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0cee5-9d51-4f68-a043-8b3267a8fd8c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:00.548064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:00.617377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 133/267] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:00.624374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f302ac-6965-49e9-8d2b-0182f6b549b8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:00.756125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f302ac-6965-49e9-8d2b-0182f6b549b8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:00.809379 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682ee7f-e86c-454c-a714-8f99030143a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:00.810257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682ee7f-e86c-454c-a714-8f99030143a0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:00.810590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682ee7f-e86c-454c-a714-8f99030143a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:00.810873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682ee7f-e86c-454c-a714-8f99030143a0 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:00.812124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682ee7f-e86c-454c-a714-8f99030143a0 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:00.813586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682ee7f-e86c-454c-a714-8f99030143a0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:00.816436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 135/268] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:00 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:00.824358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0cee5-9d51-4f68-a043-8b3267a8fd8c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:00.930044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0cee5-9d51-4f68-a043-8b3267a8fd8c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:00.967015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a03d8-62c5-4630-8d6a-d29084dc28fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:00.967709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a03d8-62c5-4630-8d6a-d29084dc28fc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:00.968000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a03d8-62c5-4630-8d6a-d29084dc28fc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:00.968281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a03d8-62c5-4630-8d6a-d29084dc28fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:00.969123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a03d8-62c5-4630-8d6a-d29084dc28fc None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f, user.id=48da884ff0ad44c6bb58f38eb43064fe) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:00.969440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a03d8-62c5-4630-8d6a-d29084dc28fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:00.970896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a03d8-62c5-4630-8d6a-d29084dc28fc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:00.977526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 134/269] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:00 2022] GET /identity/v3/role_assignments?user.id=48da884ff0ad44c6bb58f38eb43064fe&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=29dae918965d40bea71d83ffa2085316 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:01.218873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ecd15-fed5-4efa-b863-c8c7fe48124b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.219284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ecd15-fed5-4efa-b863-c8c7fe48124b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.219484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ecd15-fed5-4efa-b863-c8c7fe48124b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.221130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 136/270] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:01.226552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e01ab-d5b8-4215-8ba0-1071878bb7a4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.227093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e01ab-d5b8-4215-8ba0-1071878bb7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.227607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e01ab-d5b8-4215-8ba0-1071878bb7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.251087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-137e01ab-d5b8-4215-8ba0-1071878bb7a4 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:01.252415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-137e01ab-d5b8-4215-8ba0-1071878bb7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:01.255522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:01.339419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2518ce-4610-4979-965f-df5830bc62f4 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.339717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2518ce-4610-4979-965f-df5830bc62f4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.340004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2518ce-4610-4979-965f-df5830bc62f4 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.341397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 137/271] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:44:01.342156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 135/272] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 21 15:44:01.347021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f226d-711f-484c-97ac-820cecb0f802 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.347379 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f226d-711f-484c-97ac-820cecb0f802 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.347641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f226d-711f-484c-97ac-820cecb0f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.366108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e01ab-d5b8-4215-8ba0-1071878bb7a4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:01.367898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-cc5f226d-711f-484c-97ac-820cecb0f802 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:01.370004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cc5f226d-711f-484c-97ac-820cecb0f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:01.445327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:01.467719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 138/273] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:01.488892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e01ab-d5b8-4215-8ba0-1071878bb7a4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:01.492378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f226d-711f-484c-97ac-820cecb0f802 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:01.532557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f83bfe-84d3-4861-9412-1f3002c79f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:01.533771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f83bfe-84d3-4861-9412-1f3002c79f82 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.534291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f83bfe-84d3-4861-9412-1f3002c79f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.534764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f83bfe-84d3-4861-9412-1f3002c79f82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.547048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:01.551373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f83bfe-84d3-4861-9412-1f3002c79f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-35f83bfe-84d3-4861-9412-1f3002c79f82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:01.564188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:01.565330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:01.566110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 136/274] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:01.573007 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f83bfe-84d3-4861-9412-1f3002c79f82 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:01.611689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f226d-711f-484c-97ac-820cecb0f802 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:01.649623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e848d-bf71-47f0-af60-10c132f05381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:01.651092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e848d-bf71-47f0-af60-10c132f05381 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.651411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e848d-bf71-47f0-af60-10c132f05381 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.651763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e848d-bf71-47f0-af60-10c132f05381 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.652994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e848d-bf71-47f0-af60-10c132f05381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:01.654513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e848d-bf71-47f0-af60-10c132f05381 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:01.656517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 139/275] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:01.662536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e848d-bf71-47f0-af60-10c132f05381 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:01.694730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f83bfe-84d3-4861-9412-1f3002c79f82 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:01.731407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:01.735252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbe05d-e78e-4db8-8751-3da654653f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:01.735930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbe05d-e78e-4db8-8751-3da654653f50 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.736225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbe05d-e78e-4db8-8751-3da654653f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.736497 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbe05d-e78e-4db8-8751-3da654653f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.737248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbe05d-e78e-4db8-8751-3da654653f50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:01.737556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbe05d-e78e-4db8-8751-3da654653f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:01.739004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbe05d-e78e-4db8-8751-3da654653f50 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:01.749125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 137/276] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:01.750457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fb719-ea9e-4e15-b0d1-ce4b3fac26da None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.750751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fb719-ea9e-4e15-b0d1-ce4b3fac26da None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.751030 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fb719-ea9e-4e15-b0d1-ce4b3fac26da None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.752439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 138/277] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:01.756256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fb719-ea9e-4e15-b0d1-ce4b3fac26da None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:01.781564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e848d-bf71-47f0-af60-10c132f05381 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:01.816780 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b93d79-0bb2-486f-8927-e3738901129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:01.817455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93d79-0bb2-486f-8927-e3738901129b None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.817740 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93d79-0bb2-486f-8927-e3738901129b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.818021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93d79-0bb2-486f-8927-e3738901129b None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.818726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b93d79-0bb2-486f-8927-e3738901129b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:01.820186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b93d79-0bb2-486f-8927-e3738901129b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:01.826269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:01.842231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 140/278] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:44:01 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:44:01.843532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115597-dcef-4955-9f8e-df32a7b63ccf None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.843828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115597-dcef-4955-9f8e-df32a7b63ccf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.844389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115597-dcef-4955-9f8e-df32a7b63ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.866259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-03115597-dcef-4955-9f8e-df32a7b63ccf None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:01.867557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-03115597-dcef-4955-9f8e-df32a7b63ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:01.887094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fb719-ea9e-4e15-b0d1-ce4b3fac26da None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:01.929269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02de4-c3f6-41cb-8de6-5fd64c1ecaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:01.930177 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02de4-c3f6-41cb-8de6-5fd64c1ecaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.930465 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02de4-c3f6-41cb-8de6-5fd64c1ecaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.930743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02de4-c3f6-41cb-8de6-5fd64c1ecaf9 None admin] PATH_INFO: `/v3/users/692e0ed0cf654a3285d4296ba6c8d344` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.948762 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c02de4-c3f6-41cb-8de6-5fd64c1ecaf9 None admin] RBAC: Authorizing `identity:get_user(user_id=692e0ed0cf654a3285d4296ba6c8d344)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:01.950258 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c02de4-c3f6-41cb-8de6-5fd64c1ecaf9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:01.952239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 139/279] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:44:01 2022] GET /identity/v3/users/692e0ed0cf654a3285d4296ba6c8d344 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:01.953380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6615c6-5e4e-4a6c-9638-b94b32e1aef8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.953664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6615c6-5e4e-4a6c-9638-b94b32e1aef8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.953949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6615c6-5e4e-4a6c-9638-b94b32e1aef8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.955394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 140/280] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:01.957758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6615c6-5e4e-4a6c-9638-b94b32e1aef8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:01.975202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 141/281] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:01.975202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c3898-eec5-4f0e-bf0e-0796bce84bde None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:01.975202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c3898-eec5-4f0e-bf0e-0796bce84bde None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:01.975202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c3898-eec5-4f0e-bf0e-0796bce84bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:01.992825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5c6c3898-eec5-4f0e-bf0e-0796bce84bde None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:01.994717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5c6c3898-eec5-4f0e-bf0e-0796bce84bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:02.033755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:02.085003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 142/282] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:02.085694 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c3898-eec5-4f0e-bf0e-0796bce84bde None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:02.106166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6615c6-5e4e-4a6c-9638-b94b32e1aef8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:02.130291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:02.147709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409a5d5-1703-4eb2-b03b-7e175ac9f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:02.148677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a5d5-1703-4eb2-b03b-7e175ac9f523 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:02.149130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a5d5-1703-4eb2-b03b-7e175ac9f523 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:02.149548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a5d5-1703-4eb2-b03b-7e175ac9f523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:02.151092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409a5d5-1703-4eb2-b03b-7e175ac9f523 None admin] RBAC: Adding query filter params (role.id=c78e303f11a84bcd80e78de27d7d26f2, user.id=692e0ed0cf654a3285d4296ba6c8d344, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:02.151588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409a5d5-1703-4eb2-b03b-7e175ac9f523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:02.153199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409a5d5-1703-4eb2-b03b-7e175ac9f523 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:02.160426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 141/283] 10.222.0.46 () {56 vars in 1308 bytes} [Tue Jun 21 15:44:01 2022] GET /identity/v3/role_assignments?user.id=692e0ed0cf654a3285d4296ba6c8d344&scope.system=all&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:02.160878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409a5d5-1703-4eb2-b03b-7e175ac9f523 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:02.235431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c3898-eec5-4f0e-bf0e-0796bce84bde None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:02.291769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461edbad-ea8a-44b0-83d5-c3efd01d0336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:02.292530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461edbad-ea8a-44b0-83d5-c3efd01d0336 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:02.293130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461edbad-ea8a-44b0-83d5-c3efd01d0336 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:02.293416 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461edbad-ea8a-44b0-83d5-c3efd01d0336 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:02.303344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409a5d5-1703-4eb2-b03b-7e175ac9f523 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:02.309351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461edbad-ea8a-44b0-83d5-c3efd01d0336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-461edbad-ea8a-44b0-83d5-c3efd01d0336 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:02.320784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:02.322058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:02.323460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 143/284] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:02.336251 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461edbad-ea8a-44b0-83d5-c3efd01d0336 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:02.347843 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70457c-2677-48c9-ab11-9ded306ab4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:02.348812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70457c-2677-48c9-ab11-9ded306ab4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:02.349215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70457c-2677-48c9-ab11-9ded306ab4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:02.349508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70457c-2677-48c9-ab11-9ded306ab4b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:02.384509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70457c-2677-48c9-ab11-9ded306ab4b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7b70457c-2677-48c9-ab11-9ded306ab4b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:02.393261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:02.394229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:02.395052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 142/285] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:02.413166 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:02.419050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70457c-2677-48c9-ab11-9ded306ab4b5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:02.494540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:02.529380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461edbad-ea8a-44b0-83d5-c3efd01d0336 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:02.610965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46d0ec-0f55-4e79-914b-acb05b19c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:02.611643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46d0ec-0f55-4e79-914b-acb05b19c0dc None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:02.613044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46d0ec-0f55-4e79-914b-acb05b19c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:02.613553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46d0ec-0f55-4e79-914b-acb05b19c0dc None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:02.614581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46d0ec-0f55-4e79-914b-acb05b19c0dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:02.614907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46d0ec-0f55-4e79-914b-acb05b19c0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:02.616367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46d0ec-0f55-4e79-914b-acb05b19c0dc None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:02.621039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70457c-2677-48c9-ab11-9ded306ab4b5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:02.646521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 144/286] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:02.654777 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46d0ec-0f55-4e79-914b-acb05b19c0dc None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:02.722812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a1488-65bd-4d1e-b25c-576af15eedcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:02.723536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a1488-65bd-4d1e-b25c-576af15eedcd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:02.723829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a1488-65bd-4d1e-b25c-576af15eedcd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:02.724142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a1488-65bd-4d1e-b25c-576af15eedcd None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:02.725009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a1488-65bd-4d1e-b25c-576af15eedcd None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:02.727034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a1488-65bd-4d1e-b25c-576af15eedcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:02.730114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a1488-65bd-4d1e-b25c-576af15eedcd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:02.765810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 143/287] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:02.771272 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a1488-65bd-4d1e-b25c-576af15eedcd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:02.781248 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:02.796445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46d0ec-0f55-4e79-914b-acb05b19c0dc None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:02.861505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010028c8-0ccc-4ab2-9f4b-e3017568b8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:02.862767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010028c8-0ccc-4ab2-9f4b-e3017568b8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:02.863277 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010028c8-0ccc-4ab2-9f4b-e3017568b8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:02.863767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010028c8-0ccc-4ab2-9f4b-e3017568b8e5 None admin] PATH_INFO: `/v3/users/6d62067a9a924ef79321c2c0a3de1f73` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:02.865258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010028c8-0ccc-4ab2-9f4b-e3017568b8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=6d62067a9a924ef79321c2c0a3de1f73)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:02.867486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010028c8-0ccc-4ab2-9f4b-e3017568b8e5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:02.877444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 145/288] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:44:02 2022] GET /identity/v3/users/6d62067a9a924ef79321c2c0a3de1f73 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:02.883441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010028c8-0ccc-4ab2-9f4b-e3017568b8e5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:02.966182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a1488-65bd-4d1e-b25c-576af15eedcd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:02.979935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:03.035770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc94823-12ed-416f-a621-0e3659286898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:03.036660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc94823-12ed-416f-a621-0e3659286898 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:03.036943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc94823-12ed-416f-a621-0e3659286898 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:03.037218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc94823-12ed-416f-a621-0e3659286898 None admin] PATH_INFO: `/v3/users/036501f15e5e4039ab171a991ca611eb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:03.039640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc94823-12ed-416f-a621-0e3659286898 None admin] RBAC: Authorizing `identity:get_user(user_id=036501f15e5e4039ab171a991ca611eb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:03.041681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc94823-12ed-416f-a621-0e3659286898 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:03.043554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 144/289] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:44:02 2022] GET /identity/v3/users/036501f15e5e4039ab171a991ca611eb => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:03.049615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc94823-12ed-416f-a621-0e3659286898 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:03.114797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010028c8-0ccc-4ab2-9f4b-e3017568b8e5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:03.188023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3cc49-9961-4681-bdcc-1d6c579dff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:03.188909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3cc49-9961-4681-bdcc-1d6c579dff90 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:03.189199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3cc49-9961-4681-bdcc-1d6c579dff90 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:03.189472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3cc49-9961-4681-bdcc-1d6c579dff90 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:03.191485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3cc49-9961-4681-bdcc-1d6c579dff90 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:03.199988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3cc49-9961-4681-bdcc-1d6c579dff90 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:03.202035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 146/290] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:02 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:03.211005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3cc49-9961-4681-bdcc-1d6c579dff90 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:03.261063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc94823-12ed-416f-a621-0e3659286898 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:03.274239 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:03.316429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbabc75-f372-43f2-9b2f-fda05108686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:03.317091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbabc75-f372-43f2-9b2f-fda05108686b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:03.317379 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbabc75-f372-43f2-9b2f-fda05108686b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:03.317657 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbabc75-f372-43f2-9b2f-fda05108686b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:03.392901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:03.448601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbabc75-f372-43f2-9b2f-fda05108686b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:03.450657 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbabc75-f372-43f2-9b2f-fda05108686b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:03.453089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3cc49-9961-4681-bdcc-1d6c579dff90 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:03.522271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd3410-dc94-4061-9ff0-6ea5f2c90cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:03.523218 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd3410-dc94-4061-9ff0-6ea5f2c90cd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:03.523508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd3410-dc94-4061-9ff0-6ea5f2c90cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:03.523786 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd3410-dc94-4061-9ff0-6ea5f2c90cd1 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/users/6d62067a9a924ef79321c2c0a3de1f73/roles/5a49025933754ca3a061316bbeafb7e3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:03.530819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd3410-dc94-4061-9ff0-6ea5f2c90cd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fa16d1165e84f94bf8fc56809c2564f, user_id=6d62067a9a924ef79321c2c0a3de1f73, role_id=5a49025933754ca3a061316bbeafb7e3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:03.532391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd3410-dc94-4061-9ff0-6ea5f2c90cd1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:03.555802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 147/291] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:44:03 2022] PUT /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/users/6d62067a9a924ef79321c2c0a3de1f73/roles/5a49025933754ca3a061316bbeafb7e3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:44:03.624138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 145/292] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:03.632372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd3410-dc94-4061-9ff0-6ea5f2c90cd1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:03.750241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:03.768917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd3410-dc94-4061-9ff0-6ea5f2c90cd1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:03.821169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b9137-a92f-44b8-9f2d-647b5de1ad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:03.822179 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9137-a92f-44b8-9f2d-647b5de1ad07 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:03.822519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9137-a92f-44b8-9f2d-647b5de1ad07 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:03.822744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9137-a92f-44b8-9f2d-647b5de1ad07 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:03.823984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b9137-a92f-44b8-9f2d-647b5de1ad07 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:03.825432 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b9137-a92f-44b8-9f2d-647b5de1ad07 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:03.827149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 148/293] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:03 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:03.833508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbabc75-f372-43f2-9b2f-fda05108686b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:03.955145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:03.992397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbabc75-f372-43f2-9b2f-fda05108686b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:04.040895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910381b-c8c8-42a9-aee4-d736d053011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:04.041576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910381b-c8c8-42a9-aee4-d736d053011c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:04.041866 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910381b-c8c8-42a9-aee4-d736d053011c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:04.042149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910381b-c8c8-42a9-aee4-d736d053011c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:04.042995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910381b-c8c8-42a9-aee4-d736d053011c None admin] RBAC: Adding query filter params (role.id=c78e303f11a84bcd80e78de27d7d26f2, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f, user.id=036501f15e5e4039ab171a991ca611eb) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:04.043424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910381b-c8c8-42a9-aee4-d736d053011c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:04.044867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910381b-c8c8-42a9-aee4-d736d053011c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:04.052645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 146/294] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:03 2022] GET /identity/v3/role_assignments?user.id=036501f15e5e4039ab171a991ca611eb&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:04.482988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c4f3-7d2e-44cb-acd0-9feb532cc7d3 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:04.483393 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c4f3-7d2e-44cb-acd0-9feb532cc7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:04.483610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c4f3-7d2e-44cb-acd0-9feb532cc7d3 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:04.485315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 149/295] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:04.490881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71294-d2d9-413c-b0da-8520fa13651a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:04.491487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71294-d2d9-413c-b0da-8520fa13651a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:04.491967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df71294-d2d9-413c-b0da-8520fa13651a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:04.512576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9df71294-d2d9-413c-b0da-8520fa13651a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:04.514257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9df71294-d2d9-413c-b0da-8520fa13651a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:04.594289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 147/296] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:04.608419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed192-442d-4a01-ac11-7b49abf42082 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:04.609045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed192-442d-4a01-ac11-7b49abf42082 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:04.609537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed192-442d-4a01-ac11-7b49abf42082 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:04.611121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 150/297] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:04.616766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d207c-76c1-4967-9857-710c390e75c0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:04.617614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d207c-76c1-4967-9857-710c390e75c0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:04.618121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d207c-76c1-4967-9857-710c390e75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:04.618224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed192-442d-4a01-ac11-7b49abf42082 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:04.636428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ba4d207c-76c1-4967-9857-710c390e75c0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:04.638240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ba4d207c-76c1-4967-9857-710c390e75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:04.710847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:04.723273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 148/298] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:04.743003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d207c-76c1-4967-9857-710c390e75c0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:04.760913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed192-442d-4a01-ac11-7b49abf42082 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:04.801502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920bae1-0df4-430d-85a5-d5976f23b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:04.802801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920bae1-0df4-430d-85a5-d5976f23b121 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:04.803377 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920bae1-0df4-430d-85a5-d5976f23b121 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:04.803862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920bae1-0df4-430d-85a5-d5976f23b121 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:04.817135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920bae1-0df4-430d-85a5-d5976f23b121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-0920bae1-0df4-430d-85a5-d5976f23b121 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:04.826151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:04.827079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:44:04.827994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:04.830401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 151/299] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:04.834731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae614f1b-bd5a-4b41-8c02-9459a0ea78a2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:04.835207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae614f1b-bd5a-4b41-8c02-9459a0ea78a2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:04.835782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae614f1b-bd5a-4b41-8c02-9459a0ea78a2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:04.837311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 152/300] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:44:04.841138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae614f1b-bd5a-4b41-8c02-9459a0ea78a2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:04.856827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:04.857893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d207c-76c1-4967-9857-710c390e75c0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:04.895727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828ec85-6a28-4ec7-81f2-f0c0f2d78000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:04.896532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828ec85-6a28-4ec7-81f2-f0c0f2d78000 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:04.896821 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828ec85-6a28-4ec7-81f2-f0c0f2d78000 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:04.897128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828ec85-6a28-4ec7-81f2-f0c0f2d78000 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:04.898307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828ec85-6a28-4ec7-81f2-f0c0f2d78000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:04.900624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828ec85-6a28-4ec7-81f2-f0c0f2d78000 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:04.902524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 149/301] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:04.903776 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b1217-f24b-457d-b026-434cf2016030 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:04.904074 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b1217-f24b-457d-b026-434cf2016030 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:04.904356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b1217-f24b-457d-b026-434cf2016030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:04.921385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-749b1217-f24b-457d-b026-434cf2016030 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:04.922607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-749b1217-f24b-457d-b026-434cf2016030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:04.976924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae614f1b-bd5a-4b41-8c02-9459a0ea78a2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:04.994642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:05.007532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 150/302] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:05.007532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b1217-f24b-457d-b026-434cf2016030 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:05.021681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac9f25-3755-422d-aaca-900f259705e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:05.022617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac9f25-3755-422d-aaca-900f259705e6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:05.022910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac9f25-3755-422d-aaca-900f259705e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:05.023208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac9f25-3755-422d-aaca-900f259705e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:05.023982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac9f25-3755-422d-aaca-900f259705e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:05.024300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac9f25-3755-422d-aaca-900f259705e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:05.026548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac9f25-3755-422d-aaca-900f259705e6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:05.037105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 153/303] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:05.040460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac9f25-3755-422d-aaca-900f259705e6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:05.131448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b1217-f24b-457d-b026-434cf2016030 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:05.133233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:05.164497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac9f25-3755-422d-aaca-900f259705e6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:05.170326 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa7868-e0e0-467a-819c-539a27f3855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:05.171018 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa7868-e0e0-467a-819c-539a27f3855b None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:05.171343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa7868-e0e0-467a-819c-539a27f3855b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:05.171629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa7868-e0e0-467a-819c-539a27f3855b None admin] PATH_INFO: `/v3/groups` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:05.172336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa7868-e0e0-467a-819c-539a27f3855b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:05.173809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa7868-e0e0-467a-819c-539a27f3855b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:05.189752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 151/304] 10.222.0.46 () {60 vars in 1134 bytes} [Tue Jun 21 15:44:05 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:44:05.190428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa7868-e0e0-467a-819c-539a27f3855b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:05.214081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4ee90-26fa-4bce-becd-973719a2b4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:05.214933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ee90-26fa-4bce-becd-973719a2b4cd None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:05.215254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ee90-26fa-4bce-becd-973719a2b4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:05.215838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ee90-26fa-4bce-becd-973719a2b4cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:05.233589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4ee90-26fa-4bce-becd-973719a2b4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a7c4ee90-26fa-4bce-becd-973719a2b4cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:05.244330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:05.245599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:05.246482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 154/305] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:05.252496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4ee90-26fa-4bce-becd-973719a2b4cd None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:05.264100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:05.317580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa7868-e0e0-467a-819c-539a27f3855b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:05.356628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf36b-0afc-4582-b74b-e0548557f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:05.357519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf36b-0afc-4582-b74b-e0548557f992 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:05.357835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf36b-0afc-4582-b74b-e0548557f992 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:05.358120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf36b-0afc-4582-b74b-e0548557f992 None admin] PATH_INFO: `/v3/users/7cd0bb0cba3244819dd9cd175dadefa3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:05.374233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bf36b-0afc-4582-b74b-e0548557f992 None admin] RBAC: Authorizing `identity:get_user(user_id=7cd0bb0cba3244819dd9cd175dadefa3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:05.376020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bf36b-0afc-4582-b74b-e0548557f992 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:05.378260 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 152/306] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:44:05 2022] GET /identity/v3/users/7cd0bb0cba3244819dd9cd175dadefa3 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:05.383069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4ee90-26fa-4bce-becd-973719a2b4cd None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:05.386311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf36b-0afc-4582-b74b-e0548557f992 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:05.428531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d171f-56f4-45b0-b3a5-07a3e0538573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:05.429214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d171f-56f4-45b0-b3a5-07a3e0538573 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:05.429503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d171f-56f4-45b0-b3a5-07a3e0538573 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:05.429782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d171f-56f4-45b0-b3a5-07a3e0538573 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:05.430538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d171f-56f4-45b0-b3a5-07a3e0538573 None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:05.430885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d171f-56f4-45b0-b3a5-07a3e0538573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:05.432368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d171f-56f4-45b0-b3a5-07a3e0538573 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:05.435281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:05.445520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 155/307] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:05.451671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d171f-56f4-45b0-b3a5-07a3e0538573 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:05.508586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf36b-0afc-4582-b74b-e0548557f992 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:05.524993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:05.548774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23022853-48f4-410c-bc6c-ca2fbf8a0846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:05.550039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23022853-48f4-410c-bc6c-ca2fbf8a0846 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:05.550684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23022853-48f4-410c-bc6c-ca2fbf8a0846 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:05.551269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23022853-48f4-410c-bc6c-ca2fbf8a0846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:05.552278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23022853-48f4-410c-bc6c-ca2fbf8a0846 None admin] RBAC: Adding query filter params (role.id=5a49025933754ca3a061316bbeafb7e3, user.id=7cd0bb0cba3244819dd9cd175dadefa3, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:05.552666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23022853-48f4-410c-bc6c-ca2fbf8a0846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:05.554202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23022853-48f4-410c-bc6c-ca2fbf8a0846 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:05.560855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 153/308] 10.222.0.46 () {56 vars in 1308 bytes} [Tue Jun 21 15:44:05 2022] GET /identity/v3/role_assignments?user.id=7cd0bb0cba3244819dd9cd175dadefa3&scope.system=all&role.id=5a49025933754ca3a061316bbeafb7e3 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:05.585436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d171f-56f4-45b0-b3a5-07a3e0538573 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:05.631880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e690abf-d5eb-495c-a52a-a4e5eb539e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:05.633036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690abf-d5eb-495c-a52a-a4e5eb539e97 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:05.633471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690abf-d5eb-495c-a52a-a4e5eb539e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:05.633894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690abf-d5eb-495c-a52a-a4e5eb539e97 None admin] PATH_INFO: `/v3/users/692e0ed0cf654a3285d4296ba6c8d344` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:05.635462 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e690abf-d5eb-495c-a52a-a4e5eb539e97 None admin] RBAC: Authorizing `identity:get_user(user_id=692e0ed0cf654a3285d4296ba6c8d344)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:05.637152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e690abf-d5eb-495c-a52a-a4e5eb539e97 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:05.639500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 156/309] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:44:05 2022] GET /identity/v3/users/692e0ed0cf654a3285d4296ba6c8d344 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:05.651220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23022853-48f4-410c-bc6c-ca2fbf8a0846 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:05.774597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23022853-48f4-410c-bc6c-ca2fbf8a0846 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:05.816910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9365f6d-de93-44f9-bb19-91b3b6219dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:05.817787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365f6d-de93-44f9-bb19-91b3b6219dd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:05.818078 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365f6d-de93-44f9-bb19-91b3b6219dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:05.818361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365f6d-de93-44f9-bb19-91b3b6219dd6 None admin] PATH_INFO: `/v3/system/users/692e0ed0cf654a3285d4296ba6c8d344/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:05.819912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9365f6d-de93-44f9-bb19-91b3b6219dd6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=692e0ed0cf654a3285d4296ba6c8d344, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:05.821316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9365f6d-de93-44f9-bb19-91b3b6219dd6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:05.831038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 154/310] 10.222.0.46 () {58 vars in 1334 bytes} [Tue Jun 21 15:44:05 2022] PUT /identity/v3/system/users/692e0ed0cf654a3285d4296ba6c8d344/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:44:06.133198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806dcb3-bc83-4c0d-8fe3-ae738b62e7e5 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:06.133693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806dcb3-bc83-4c0d-8fe3-ae738b62e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:06.133693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806dcb3-bc83-4c0d-8fe3-ae738b62e7e5 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:06.136266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 157/311] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:06.142229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1188-85aa-416c-b71c-043f5c3ba839 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:06.142680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1188-85aa-416c-b71c-043f5c3ba839 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:06.142908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1188-85aa-416c-b71c-043f5c3ba839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:06.160510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0e2f1188-85aa-416c-b71c-043f5c3ba839 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:06.161719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0e2f1188-85aa-416c-b71c-043f5c3ba839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:06.199878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:06.235506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 155/312] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:06.259937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806dcb3-bc83-4c0d-8fe3-ae738b62e7e5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:06.335545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:06.374565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806dcb3-bc83-4c0d-8fe3-ae738b62e7e5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:06.412614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd28079-4eb4-42a3-8bbc-0dcb3a8150c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:06.413431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd28079-4eb4-42a3-8bbc-0dcb3a8150c1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:06.413722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd28079-4eb4-42a3-8bbc-0dcb3a8150c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:06.414006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd28079-4eb4-42a3-8bbc-0dcb3a8150c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:06.425412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd28079-4eb4-42a3-8bbc-0dcb3a8150c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-5cd28079-4eb4-42a3-8bbc-0dcb3a8150c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:06.433525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:06.434403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:06.435235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 158/313] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:06.441614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1188-85aa-416c-b71c-043f5c3ba839 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:06.545958 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1188-85aa-416c-b71c-043f5c3ba839 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:06.581189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6f71d-ef0e-4cb8-be74-d24b5e7391c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:06.581867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6f71d-ef0e-4cb8-be74-d24b5e7391c3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:06.582159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6f71d-ef0e-4cb8-be74-d24b5e7391c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:06.582441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6f71d-ef0e-4cb8-be74-d24b5e7391c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:06.583288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6f71d-ef0e-4cb8-be74-d24b5e7391c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:06.583602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6f71d-ef0e-4cb8-be74-d24b5e7391c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:06.585072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6f71d-ef0e-4cb8-be74-d24b5e7391c3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:06.594385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 156/314] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:06.600072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd28079-4eb4-42a3-8bbc-0dcb3a8150c1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:06.709587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd28079-4eb4-42a3-8bbc-0dcb3a8150c1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:06.738172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:06.748413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0be3b-e4a8-4b43-85bc-978c509bbf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:06.749292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0be3b-e4a8-4b43-85bc-978c509bbf16 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:06.749578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0be3b-e4a8-4b43-85bc-978c509bbf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:06.749861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0be3b-e4a8-4b43-85bc-978c509bbf16 None admin] PATH_INFO: `/v3/users/6d62067a9a924ef79321c2c0a3de1f73` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:06.751082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0be3b-e4a8-4b43-85bc-978c509bbf16 None admin] RBAC: Authorizing `identity:get_user(user_id=6d62067a9a924ef79321c2c0a3de1f73)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:06.752640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0be3b-e4a8-4b43-85bc-978c509bbf16 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:06.754349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 159/315] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:44:06 2022] GET /identity/v3/users/6d62067a9a924ef79321c2c0a3de1f73 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:06.760462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6f71d-ef0e-4cb8-be74-d24b5e7391c3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:06.796004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:06.873525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6f71d-ef0e-4cb8-be74-d24b5e7391c3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:06.909514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddef6a-3eb6-4ba4-a998-7e36bd078fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:06.910174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddef6a-3eb6-4ba4-a998-7e36bd078fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:06.910458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddef6a-3eb6-4ba4-a998-7e36bd078fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:06.910737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddef6a-3eb6-4ba4-a998-7e36bd078fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:06.981648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddef6a-3eb6-4ba4-a998-7e36bd078fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:06.983031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddef6a-3eb6-4ba4-a998-7e36bd078fe1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:07.017209 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:07.088487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 157/316] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:07.094170 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0be3b-e4a8-4b43-85bc-978c509bbf16 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:07.200808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0be3b-e4a8-4b43-85bc-978c509bbf16 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:07.234810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5fa72-b240-4ae4-8e50-9a9dbe58b04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:07.235623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5fa72-b240-4ae4-8e50-9a9dbe58b04c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:07.235909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5fa72-b240-4ae4-8e50-9a9dbe58b04c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:07.236187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5fa72-b240-4ae4-8e50-9a9dbe58b04c None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:07.237392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5fa72-b240-4ae4-8e50-9a9dbe58b04c None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:07.238845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5fa72-b240-4ae4-8e50-9a9dbe58b04c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:07.245180 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 160/317] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:07 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:07.247342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddef6a-3eb6-4ba4-a998-7e36bd078fe1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:07.349791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddef6a-3eb6-4ba4-a998-7e36bd078fe1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:07.386778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37262a09-f5af-4832-8560-144c03552a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:07.387464 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262a09-f5af-4832-8560-144c03552a4e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:07.387751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262a09-f5af-4832-8560-144c03552a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:07.388030 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262a09-f5af-4832-8560-144c03552a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:07.389123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37262a09-f5af-4832-8560-144c03552a4e None admin] RBAC: Adding query filter params (role.id=5a49025933754ca3a061316bbeafb7e3, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f, user.id=6d62067a9a924ef79321c2c0a3de1f73) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:07.389435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37262a09-f5af-4832-8560-144c03552a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:07.390872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37262a09-f5af-4832-8560-144c03552a4e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:07.392794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:07.403300 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 158/318] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:07 2022] GET /identity/v3/role_assignments?user.id=6d62067a9a924ef79321c2c0a3de1f73&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=5a49025933754ca3a061316bbeafb7e3 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:07.511543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c926d-38af-4489-8a17-870462ef95fe None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:07.511866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c926d-38af-4489-8a17-870462ef95fe None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:07.512030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c926d-38af-4489-8a17-870462ef95fe None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:07.513697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 161/319] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:07.519698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8039f41-e8d5-44ac-88ba-ec382dbacf33 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:07.519997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8039f41-e8d5-44ac-88ba-ec382dbacf33 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:07.520263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8039f41-e8d5-44ac-88ba-ec382dbacf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:07.539975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e8039f41-e8d5-44ac-88ba-ec382dbacf33 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:07.541936 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e8039f41-e8d5-44ac-88ba-ec382dbacf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:07.621793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 159/320] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:07.646920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c926d-38af-4489-8a17-870462ef95fe None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:07.706134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857710b-bc2d-42ee-8898-6de5a0638782 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:07.706436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857710b-bc2d-42ee-8898-6de5a0638782 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:07.706859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857710b-bc2d-42ee-8898-6de5a0638782 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:07.708501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 160/321] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:07.714055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2246dc-72df-4561-b1a5-2efd248e4da8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:07.714903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2246dc-72df-4561-b1a5-2efd248e4da8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:07.715229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2246dc-72df-4561-b1a5-2efd248e4da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:07.720285 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:07.733375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9b2246dc-72df-4561-b1a5-2efd248e4da8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:07.734575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9b2246dc-72df-4561-b1a5-2efd248e4da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:07.770314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c926d-38af-4489-8a17-870462ef95fe None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:07.808988 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 161/322] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:07.812001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28203fc3-7be0-4dc2-8e26-9fdaecfe4254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:07.812897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28203fc3-7be0-4dc2-8e26-9fdaecfe4254 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:07.813256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28203fc3-7be0-4dc2-8e26-9fdaecfe4254 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:07.813492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28203fc3-7be0-4dc2-8e26-9fdaecfe4254 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:07.814696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28203fc3-7be0-4dc2-8e26-9fdaecfe4254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:07.816190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28203fc3-7be0-4dc2-8e26-9fdaecfe4254 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:07.819212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 162/323] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:07.823725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2246dc-72df-4561-b1a5-2efd248e4da8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:07.836531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28203fc3-7be0-4dc2-8e26-9fdaecfe4254 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:07.892235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:07.941446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2246dc-72df-4561-b1a5-2efd248e4da8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:07.951293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28203fc3-7be0-4dc2-8e26-9fdaecfe4254 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:07.979672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86ea8e-01a3-4d11-8636-1e7d75be1642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:07.980344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86ea8e-01a3-4d11-8636-1e7d75be1642 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:07.980627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86ea8e-01a3-4d11-8636-1e7d75be1642 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:07.980905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86ea8e-01a3-4d11-8636-1e7d75be1642 None admin] PATH_INFO: `/v3/groups` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:07.981592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86ea8e-01a3-4d11-8636-1e7d75be1642 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:07.983037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86ea8e-01a3-4d11-8636-1e7d75be1642 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:07.984353 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:07.992873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fadc6-4219-44a6-a41a-6984d14dd607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:07.993772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fadc6-4219-44a6-a41a-6984d14dd607 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:07.994068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fadc6-4219-44a6-a41a-6984d14dd607 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:07.994335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fadc6-4219-44a6-a41a-6984d14dd607 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:07.999836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 162/324] 10.222.0.46 () {60 vars in 1134 bytes} [Tue Jun 21 15:44:07 2022] POST /identity/v3/groups => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:44:08.010998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fadc6-4219-44a6-a41a-6984d14dd607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-c55fadc6-4219-44a6-a41a-6984d14dd607 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:08.019869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:08.021042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:44:08.022019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:08.025331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 163/325] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:08.031118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86ea8e-01a3-4d11-8636-1e7d75be1642 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:08.077174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b94472-6e34-4b9c-86cf-84185ff4fcbd None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:08.077532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b94472-6e34-4b9c-86cf-84185ff4fcbd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:08.077757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b94472-6e34-4b9c-86cf-84185ff4fcbd None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:08.079203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 164/326] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:44:08.084777 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c59bdc-1f96-4ba9-9176-8d92e60f4b2f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:08.085075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c59bdc-1f96-4ba9-9176-8d92e60f4b2f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:08.085353 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c59bdc-1f96-4ba9-9176-8d92e60f4b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:08.106260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-47c59bdc-1f96-4ba9-9176-8d92e60f4b2f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:08.107570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-47c59bdc-1f96-4ba9-9176-8d92e60f4b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:08.149903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86ea8e-01a3-4d11-8636-1e7d75be1642 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:08.171030 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:08.186604 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 165/327] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:08.197189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb933cde-5f57-4f4c-bd7e-de43a29cd8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:08.198073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb933cde-5f57-4f4c-bd7e-de43a29cd8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:08.198364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb933cde-5f57-4f4c-bd7e-de43a29cd8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:08.198640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb933cde-5f57-4f4c-bd7e-de43a29cd8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:08.199431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb933cde-5f57-4f4c-bd7e-de43a29cd8f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:08.199743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb933cde-5f57-4f4c-bd7e-de43a29cd8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:08.201242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb933cde-5f57-4f4c-bd7e-de43a29cd8f3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:08.210411 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 163/328] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:08.216402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb933cde-5f57-4f4c-bd7e-de43a29cd8f3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:08.216557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c59bdc-1f96-4ba9-9176-8d92e60f4b2f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:08.349174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c59bdc-1f96-4ba9-9176-8d92e60f4b2f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:08.352696 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb933cde-5f57-4f4c-bd7e-de43a29cd8f3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:08.372569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:08.391145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0be8f-ee4d-435e-ba2f-6a1aaf03b423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:08.392278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0be8f-ee4d-435e-ba2f-6a1aaf03b423 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:08.395184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0be8f-ee4d-435e-ba2f-6a1aaf03b423 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:08.395184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0be8f-ee4d-435e-ba2f-6a1aaf03b423 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:08.402870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e68139-b637-4ee4-94e9-8d808b2a6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:08.405451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e68139-b637-4ee4-94e9-8d808b2a6936 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:08.405451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e68139-b637-4ee4-94e9-8d808b2a6936 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:08.405451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e68139-b637-4ee4-94e9-8d808b2a6936 None admin] PATH_INFO: `/v3/users/7cd0bb0cba3244819dd9cd175dadefa3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:08.405929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e68139-b637-4ee4-94e9-8d808b2a6936 None admin] RBAC: Authorizing `identity:get_user(user_id=7cd0bb0cba3244819dd9cd175dadefa3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:08.407841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e68139-b637-4ee4-94e9-8d808b2a6936 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:08.409693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 164/329] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:44:08 2022] GET /identity/v3/users/7cd0bb0cba3244819dd9cd175dadefa3 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:08.411712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0be8f-ee4d-435e-ba2f-6a1aaf03b423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:08.414731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e68139-b637-4ee4-94e9-8d808b2a6936 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-d2a0be8f-ee4d-435e-ba2f-6a1aaf03b423 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:08.422466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:08.423440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:08.424246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 166/330] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:08.432469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0be8f-ee4d-435e-ba2f-6a1aaf03b423 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:08.489406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:08.549653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e68139-b637-4ee4-94e9-8d808b2a6936 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:08.564276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0be8f-ee4d-435e-ba2f-6a1aaf03b423 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:08.588445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da5236-5786-4a41-a928-9995004e51b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:08.589330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da5236-5786-4a41-a928-9995004e51b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:08.589621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da5236-5786-4a41-a928-9995004e51b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:08.589896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da5236-5786-4a41-a928-9995004e51b2 None admin] PATH_INFO: `/v3/system/users/7cd0bb0cba3244819dd9cd175dadefa3/roles/5a49025933754ca3a061316bbeafb7e3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:08.591498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da5236-5786-4a41-a928-9995004e51b2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7cd0bb0cba3244819dd9cd175dadefa3, role_id=5a49025933754ca3a061316bbeafb7e3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:08.592906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da5236-5786-4a41-a928-9995004e51b2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:08.605763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 165/331] 10.222.0.46 () {58 vars in 1334 bytes} [Tue Jun 21 15:44:08 2022] PUT /identity/v3/system/users/7cd0bb0cba3244819dd9cd175dadefa3/roles/5a49025933754ca3a061316bbeafb7e3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:44:08.611569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04050c5a-8a88-4ee5-a5e4-f44fc995a6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:08.612294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04050c5a-8a88-4ee5-a5e4-f44fc995a6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:08.612599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04050c5a-8a88-4ee5-a5e4-f44fc995a6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:08.612881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04050c5a-8a88-4ee5-a5e4-f44fc995a6f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:08.613706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04050c5a-8a88-4ee5-a5e4-f44fc995a6f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:08.614022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04050c5a-8a88-4ee5-a5e4-f44fc995a6f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:08.615524 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04050c5a-8a88-4ee5-a5e4-f44fc995a6f4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:08.628020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 167/332] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:08.633924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da5236-5786-4a41-a928-9995004e51b2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:08.762087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da5236-5786-4a41-a928-9995004e51b2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:08.778289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:08.803537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287689ad-c445-4d43-a18a-565441974a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:08.804527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287689ad-c445-4d43-a18a-565441974a91 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:08.804815 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287689ad-c445-4d43-a18a-565441974a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:08.805162 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287689ad-c445-4d43-a18a-565441974a91 None admin] PATH_INFO: `/v3/users/692e0ed0cf654a3285d4296ba6c8d344` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:08.807820 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287689ad-c445-4d43-a18a-565441974a91 None admin] RBAC: Authorizing `identity:get_user(user_id=692e0ed0cf654a3285d4296ba6c8d344)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:08.809387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287689ad-c445-4d43-a18a-565441974a91 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:08.814360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 166/333] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:44:08 2022] GET /identity/v3/users/692e0ed0cf654a3285d4296ba6c8d344 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:08.817570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04050c5a-8a88-4ee5-a5e4-f44fc995a6f4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:08.869531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:08.948178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04050c5a-8a88-4ee5-a5e4-f44fc995a6f4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:08.985355 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b533f33-32a0-4acc-8da2-6c8ce487a2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:08.986062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533f33-32a0-4acc-8da2-6c8ce487a2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:08.986299 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533f33-32a0-4acc-8da2-6c8ce487a2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:08.986574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b533f33-32a0-4acc-8da2-6c8ce487a2e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:08.987441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b533f33-32a0-4acc-8da2-6c8ce487a2e2 None admin] RBAC: Adding query filter params (role.id=c78e303f11a84bcd80e78de27d7d26f2, user.id=692e0ed0cf654a3285d4296ba6c8d344, scope.system=all) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:08.987755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b533f33-32a0-4acc-8da2-6c8ce487a2e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:08.989243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b533f33-32a0-4acc-8da2-6c8ce487a2e2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:09.008557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 168/334] 10.222.0.46 () {56 vars in 1308 bytes} [Tue Jun 21 15:44:08 2022] GET /identity/v3/role_assignments?user.id=692e0ed0cf654a3285d4296ba6c8d344&scope.system=all&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:10.376112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4208-524b-4fc1-b4a3-bc333ab9a936 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:10.376689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4208-524b-4fc1-b4a3-bc333ab9a936 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:10.377812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4208-524b-4fc1-b4a3-bc333ab9a936 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:10.379230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 167/335] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:10.385665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218616a-cb1b-41ac-8416-2ff9f6a4131b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:10.386178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218616a-cb1b-41ac-8416-2ff9f6a4131b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:10.386260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218616a-cb1b-41ac-8416-2ff9f6a4131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:10.406032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1218616a-cb1b-41ac-8416-2ff9f6a4131b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:10.407242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1218616a-cb1b-41ac-8416-2ff9f6a4131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:10.496113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 169/336] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:10.532514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4208-524b-4fc1-b4a3-bc333ab9a936 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:10.690650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4208-524b-4fc1-b4a3-bc333ab9a936 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:10.786962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d92aa-c73c-434d-9ad0-d2bf932eb3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:10.787859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d92aa-c73c-434d-9ad0-d2bf932eb3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:10.788154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d92aa-c73c-434d-9ad0-d2bf932eb3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:10.788434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d92aa-c73c-434d-9ad0-d2bf932eb3b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:10.795957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48a24-39ba-40b0-8404-d125fde8e752 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:10.796243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48a24-39ba-40b0-8404-d125fde8e752 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:10.796712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae48a24-39ba-40b0-8404-d125fde8e752 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:10.802590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 170/337] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:10.804777 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6752b2e-39d6-416a-a429-bc54f4ed4608 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:10.805290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6752b2e-39d6-416a-a429-bc54f4ed4608 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:10.806384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6752b2e-39d6-416a-a429-bc54f4ed4608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:10.815194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d92aa-c73c-434d-9ad0-d2bf932eb3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-214d92aa-c73c-434d-9ad0-d2bf932eb3b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:10.820721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:10.822733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:10.823906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 168/338] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:10.831197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d92aa-c73c-434d-9ad0-d2bf932eb3b9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:10.869224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f6752b2e-39d6-416a-a429-bc54f4ed4608 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:10.871488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f6752b2e-39d6-416a-a429-bc54f4ed4608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:10.947510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:10.976920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:11.079827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 171/339] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:11.158022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d92aa-c73c-434d-9ad0-d2bf932eb3b9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:11.167763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6752b2e-39d6-416a-a429-bc54f4ed4608 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:11.288389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf00c-d723-48ab-9a3b-c39c5f62555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:11.288995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf00c-d723-48ab-9a3b-c39c5f62555b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:11.289285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf00c-d723-48ab-9a3b-c39c5f62555b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:11.289569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf00c-d723-48ab-9a3b-c39c5f62555b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:11.290981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daf00c-d723-48ab-9a3b-c39c5f62555b None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:11.291321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daf00c-d723-48ab-9a3b-c39c5f62555b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:11.292734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3daf00c-d723-48ab-9a3b-c39c5f62555b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:11.324365 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 169/340] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:11.329797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf00c-d723-48ab-9a3b-c39c5f62555b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:11.432367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6752b2e-39d6-416a-a429-bc54f4ed4608 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:11.496129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daf00c-d723-48ab-9a3b-c39c5f62555b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:11.497750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:11.520536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0987aa6-162c-4011-9966-7589def64683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:11.521378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987aa6-162c-4011-9966-7589def64683 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:11.521665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987aa6-162c-4011-9966-7589def64683 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:11.521946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987aa6-162c-4011-9966-7589def64683 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:11.540960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d5725-d3e6-4d9b-b0f1-65f71457f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:11.541553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5725-d3e6-4d9b-b0f1-65f71457f650 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:11.541844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5725-d3e6-4d9b-b0f1-65f71457f650 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:11.542126 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d5725-d3e6-4d9b-b0f1-65f71457f650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:11.547627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0987aa6-162c-4011-9966-7589def64683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f0987aa6-162c-4011-9966-7589def64683 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:11.563496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:11.564513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:11.565372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:11.571855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 172/341] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:44:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:11.585967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0987aa6-162c-4011-9966-7589def64683 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:11.639904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:11.647523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d5725-d3e6-4d9b-b0f1-65f71457f650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:11.649012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d5725-d3e6-4d9b-b0f1-65f71457f650 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:11.762779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 170/342] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:11.764432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae962a6d-585b-4879-b3c8-9b062b745d16 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:11.764727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae962a6d-585b-4879-b3c8-9b062b745d16 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:11.765014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae962a6d-585b-4879-b3c8-9b062b745d16 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:11.766603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 171/343] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:11.773040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b5e8b-2a1b-4b50-a6e4-98b10ae81af4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:11.773334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b5e8b-2a1b-4b50-a6e4-98b10ae81af4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:11.773624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b5e8b-2a1b-4b50-a6e4-98b10ae81af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:11.785246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:11.808708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2a5b5e8b-2a1b-4b50-a6e4-98b10ae81af4 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:11.809852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2a5b5e8b-2a1b-4b50-a6e4-98b10ae81af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:11.856534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0987aa6-162c-4011-9966-7589def64683 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:11.916481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf47a80-1971-4343-bfc3-3cc2d32a953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:11.917240 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf47a80-1971-4343-bfc3-3cc2d32a953c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:11.917536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf47a80-1971-4343-bfc3-3cc2d32a953c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:11.917815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf47a80-1971-4343-bfc3-3cc2d32a953c None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:11.918577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf47a80-1971-4343-bfc3-3cc2d32a953c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:11.918891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf47a80-1971-4343-bfc3-3cc2d32a953c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:11.920311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf47a80-1971-4343-bfc3-3cc2d32a953c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:11.926844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 172/344] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:11.927742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b5e8b-2a1b-4b50-a6e4-98b10ae81af4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:11.935016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 173/345] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:11.935016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60a4a-fbe9-4c47-b4dc-a9283691b29c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:11.935016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60a4a-fbe9-4c47-b4dc-a9283691b29c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:11.935016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60a4a-fbe9-4c47-b4dc-a9283691b29c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:11.935016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 174/346] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:11.939505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d60a4a-fbe9-4c47-b4dc-a9283691b29c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:12.073772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:12.083952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b5e8b-2a1b-4b50-a6e4-98b10ae81af4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:12.104423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d60a4a-fbe9-4c47-b4dc-a9283691b29c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:12.132868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:12.140840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a57c28-50b6-4aa7-a5c6-85f21d7d16f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:12.142003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a57c28-50b6-4aa7-a5c6-85f21d7d16f7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:12.142453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a57c28-50b6-4aa7-a5c6-85f21d7d16f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:12.142946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a57c28-50b6-4aa7-a5c6-85f21d7d16f7 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:12.144605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a57c28-50b6-4aa7-a5c6-85f21d7d16f7 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:12.146112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a57c28-50b6-4aa7-a5c6-85f21d7d16f7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:12.148625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 173/347] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:11 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:12.150980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606538c4-625a-4c26-b0de-4cfa36fbf178 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:12.153993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc1325-0b57-4706-84ea-208b93ca30c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:12.154506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606538c4-625a-4c26-b0de-4cfa36fbf178 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:12.154898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc1325-0b57-4706-84ea-208b93ca30c3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:12.155118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606538c4-625a-4c26-b0de-4cfa36fbf178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:12.155257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc1325-0b57-4706-84ea-208b93ca30c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:12.155497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc1325-0b57-4706-84ea-208b93ca30c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:12.174951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-606538c4-625a-4c26-b0de-4cfa36fbf178 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:12.176253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-606538c4-625a-4c26-b0de-4cfa36fbf178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:12.255529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc1325-0b57-4706-84ea-208b93ca30c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:12.257490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc1325-0b57-4706-84ea-208b93ca30c3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:12.258464 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 174/348] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:12.260006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606538c4-625a-4c26-b0de-4cfa36fbf178 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:12.378520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:12.382850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606538c4-625a-4c26-b0de-4cfa36fbf178 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:12.404423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 175/349] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:12.406251 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc1325-0b57-4706-84ea-208b93ca30c3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:12.427204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:12.437632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29587f54-861b-4c2b-af9f-31524e12e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:12.438970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29587f54-861b-4c2b-af9f-31524e12e64f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:12.439537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29587f54-861b-4c2b-af9f-31524e12e64f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:12.439830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29587f54-861b-4c2b-af9f-31524e12e64f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:12.452669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29587f54-861b-4c2b-af9f-31524e12e64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-29587f54-861b-4c2b-af9f-31524e12e64f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:12.463724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:12.465009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:12.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 175/350] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:12.466982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29587f54-861b-4c2b-af9f-31524e12e64f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:12.571693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc1325-0b57-4706-84ea-208b93ca30c3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:12.612180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29587f54-861b-4c2b-af9f-31524e12e64f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:12.627083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4671ec3-a389-433c-8129-ae51752d506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:12.628517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4671ec3-a389-433c-8129-ae51752d506b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:12.629105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4671ec3-a389-433c-8129-ae51752d506b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:12.629593 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4671ec3-a389-433c-8129-ae51752d506b None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:12.637525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4671ec3-a389-433c-8129-ae51752d506b None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:12.639775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4671ec3-a389-433c-8129-ae51752d506b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:12.642142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 176/351] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:12 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:12.643174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4671ec3-a389-433c-8129-ae51752d506b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:12.649317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11866ce-ac26-453d-a379-b72d05769cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:12.651041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11866ce-ac26-453d-a379-b72d05769cea None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:12.651410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11866ce-ac26-453d-a379-b72d05769cea None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:12.651703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11866ce-ac26-453d-a379-b72d05769cea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:12.669901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11866ce-ac26-453d-a379-b72d05769cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c11866ce-ac26-453d-a379-b72d05769cea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:12.679973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:12.681135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:44:12.682052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:12.685241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 176/352] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:12.686311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11866ce-ac26-453d-a379-b72d05769cea None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:12.702369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:12.753956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:12.774978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4671ec3-a389-433c-8129-ae51752d506b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:12.824726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11866ce-ac26-453d-a379-b72d05769cea None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:12.827088 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce23e-5992-4b2e-a26a-b0cdbe833e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:12.829620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce23e-5992-4b2e-a26a-b0cdbe833e59 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:12.830069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce23e-5992-4b2e-a26a-b0cdbe833e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:12.830492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce23e-5992-4b2e-a26a-b0cdbe833e59 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:12.832342 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce23e-5992-4b2e-a26a-b0cdbe833e59 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:12.834607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce23e-5992-4b2e-a26a-b0cdbe833e59 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:12.836745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 177/353] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:12 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:12.840037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce23e-5992-4b2e-a26a-b0cdbe833e59 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:12.876268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f24fe-8036-490e-99cb-3c25e217f45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:12.877318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f24fe-8036-490e-99cb-3c25e217f45d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:12.877830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f24fe-8036-490e-99cb-3c25e217f45d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:12.878961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f24fe-8036-490e-99cb-3c25e217f45d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:12.880077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f24fe-8036-490e-99cb-3c25e217f45d None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:12.880636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f24fe-8036-490e-99cb-3c25e217f45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:12.882330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f24fe-8036-490e-99cb-3c25e217f45d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:12.894363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 177/354] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:12.895613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f24fe-8036-490e-99cb-3c25e217f45d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:12.990474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce23e-5992-4b2e-a26a-b0cdbe833e59 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:13.010655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:13.037189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f24fe-8036-490e-99cb-3c25e217f45d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:13.046662 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7979-5222-4837-b749-68321bc58c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:13.048049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7979-5222-4837-b749-68321bc58c16 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.048562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7979-5222-4837-b749-68321bc58c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.049144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7979-5222-4837-b749-68321bc58c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.050201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7979-5222-4837-b749-68321bc58c16 None admin] RBAC: Adding query filter params (group.id=a7a286534cbc463d86f040d67c900a28, role.id=c78e303f11a84bcd80e78de27d7d26f2, scope.project.id=21ac6b9f65304534adce7421674442c6) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:13.050740 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7979-5222-4837-b749-68321bc58c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:13.051935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:13.053724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7979-5222-4837-b749-68321bc58c16 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:13.062045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 178/355] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jun 21 15:44:12 2022] GET /identity/v3/role_assignments?group.id=a7a286534cbc463d86f040d67c900a28&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:13.063205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7979-5222-4837-b749-68321bc58c16 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:13.078212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a74b0-919e-40f6-bac6-6426a924f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:13.078893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a74b0-919e-40f6-bac6-6426a924f262 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.079220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a74b0-919e-40f6-bac6-6426a924f262 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.079506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a74b0-919e-40f6-bac6-6426a924f262 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.080347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a74b0-919e-40f6-bac6-6426a924f262 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:13.080658 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a74b0-919e-40f6-bac6-6426a924f262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:13.082105 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a74b0-919e-40f6-bac6-6426a924f262 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:13.092862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 178/356] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:13.093742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a74b0-919e-40f6-bac6-6426a924f262 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:13.203849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7979-5222-4837-b749-68321bc58c16 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:13.221336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a74b0-919e-40f6-bac6-6426a924f262 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:13.264876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b47f7-89d0-4cef-955b-9c7ad26faa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:13.266453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b47f7-89d0-4cef-955b-9c7ad26faa95 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.267085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b47f7-89d0-4cef-955b-9c7ad26faa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.267605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b47f7-89d0-4cef-955b-9c7ad26faa95 None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.269387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b47f7-89d0-4cef-955b-9c7ad26faa95 None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:13.269905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f1958-b9ff-41ad-9600-a18ae48a798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:13.270685 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f1958-b9ff-41ad-9600-a18ae48a798f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.271071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f1958-b9ff-41ad-9600-a18ae48a798f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.271483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f1958-b9ff-41ad-9600-a18ae48a798f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.271722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b47f7-89d0-4cef-955b-9c7ad26faa95 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:13.273739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 179/357] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:13 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:13.276204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365831-244a-4070-a0ec-d36c6ac97fa6 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.276649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365831-244a-4070-a0ec-d36c6ac97fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3365831-244a-4070-a0ec-d36c6ac97fa6 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.279985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 180/358] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:13.280870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365831-244a-4070-a0ec-d36c6ac97fa6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:13.327358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:13.342505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:13.362796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f1958-b9ff-41ad-9600-a18ae48a798f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:13.365277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f1958-b9ff-41ad-9600-a18ae48a798f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:13.423352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3365831-244a-4070-a0ec-d36c6ac97fa6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:13.465493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e81bb-06be-48fc-895f-94ed84d5ccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:13.466792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e81bb-06be-48fc-895f-94ed84d5ccac None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.467289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e81bb-06be-48fc-895f-94ed84d5ccac None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.467744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e81bb-06be-48fc-895f-94ed84d5ccac None admin] PATH_INFO: `/v3/users/7cd0bb0cba3244819dd9cd175dadefa3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.469364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e81bb-06be-48fc-895f-94ed84d5ccac None admin] RBAC: Authorizing `identity:get_user(user_id=7cd0bb0cba3244819dd9cd175dadefa3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:13.471042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e81bb-06be-48fc-895f-94ed84d5ccac None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:13.472950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 181/359] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:44:13 2022] GET /identity/v3/users/7cd0bb0cba3244819dd9cd175dadefa3 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:13.473933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e81bb-06be-48fc-895f-94ed84d5ccac None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:13.485432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 179/360] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:13.486874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ab7da-9efd-452f-b625-057272dd3384 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.487182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ab7da-9efd-452f-b625-057272dd3384 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.487455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ab7da-9efd-452f-b625-057272dd3384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.506439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d52ab7da-9efd-452f-b625-057272dd3384 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:13.509418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d52ab7da-9efd-452f-b625-057272dd3384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:13.604489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 180/361] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:13.605861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8ee12-2816-41dd-98b0-638f7632efde None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.606157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8ee12-2816-41dd-98b0-638f7632efde None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.606494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8ee12-2816-41dd-98b0-638f7632efde None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.609070 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 181/362] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:13.609676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8ee12-2816-41dd-98b0-638f7632efde None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:13.622153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e81bb-06be-48fc-895f-94ed84d5ccac None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:13.631661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:13.643584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:13.667672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823b8d-b936-486c-a6c1-c167c9ef8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:13.668466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823b8d-b936-486c-a6c1-c167c9ef8017 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.668837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823b8d-b936-486c-a6c1-c167c9ef8017 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.669180 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823b8d-b936-486c-a6c1-c167c9ef8017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.671198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823b8d-b936-486c-a6c1-c167c9ef8017 None admin] RBAC: Adding query filter params (group.id=a7a286534cbc463d86f040d67c900a28, role.id=8bd0b3ec424b423da0670486cc02bc49, scope.project.id=21ac6b9f65304534adce7421674442c6) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:13.671591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823b8d-b936-486c-a6c1-c167c9ef8017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:13.673116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823b8d-b936-486c-a6c1-c167c9ef8017 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:13.680364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 182/363] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jun 21 15:44:13 2022] GET /identity/v3/role_assignments?group.id=a7a286534cbc463d86f040d67c900a28&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=8bd0b3ec424b423da0670486cc02bc49 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:13.683959 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823b8d-b936-486c-a6c1-c167c9ef8017 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:13.771573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8ee12-2816-41dd-98b0-638f7632efde None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:13.820506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10feea1-9ce3-46af-ac35-92d683fe70ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:13.820744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823b8d-b936-486c-a6c1-c167c9ef8017 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:13.821647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10feea1-9ce3-46af-ac35-92d683fe70ca None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.822157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10feea1-9ce3-46af-ac35-92d683fe70ca None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.822584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10feea1-9ce3-46af-ac35-92d683fe70ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.823908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10feea1-9ce3-46af-ac35-92d683fe70ca None admin] RBAC: Adding query filter params (role.id=5a49025933754ca3a061316bbeafb7e3, user.id=7cd0bb0cba3244819dd9cd175dadefa3, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:13.824399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10feea1-9ce3-46af-ac35-92d683fe70ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:13.827062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10feea1-9ce3-46af-ac35-92d683fe70ca None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:13.849964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 182/364] 10.222.0.46 () {56 vars in 1308 bytes} [Tue Jun 21 15:44:13 2022] GET /identity/v3/role_assignments?user.id=7cd0bb0cba3244819dd9cd175dadefa3&scope.system=all&role.id=5a49025933754ca3a061316bbeafb7e3 => generated 510 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:13.851589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4f1c8-ae7d-4f3f-b570-feeb8c46225b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.852031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4f1c8-ae7d-4f3f-b570-feeb8c46225b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.853026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4f1c8-ae7d-4f3f-b570-feeb8c46225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.876570 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-52f4f1c8-ae7d-4f3f-b570-feeb8c46225b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:13.877808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-52f4f1c8-ae7d-4f3f-b570-feeb8c46225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:13.881430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cdf45-5d6e-4f25-883c-26865cc526c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:13.882571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cdf45-5d6e-4f25-883c-26865cc526c8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:13.882964 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cdf45-5d6e-4f25-883c-26865cc526c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:13.883447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cdf45-5d6e-4f25-883c-26865cc526c8 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:13.886131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cdf45-5d6e-4f25-883c-26865cc526c8 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:13.888124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cdf45-5d6e-4f25-883c-26865cc526c8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:13.890910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 183/365] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:13 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:13.892655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cdf45-5d6e-4f25-883c-26865cc526c8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:13.972630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:14.009302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:14.036585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 183/366] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:14.037386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4f1c8-ae7d-4f3f-b570-feeb8c46225b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:14.084474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cdf45-5d6e-4f25-883c-26865cc526c8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:14.128717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb40b9-091a-4407-a1f0-044cfdf95f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:14.130020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb40b9-091a-4407-a1f0-044cfdf95f6f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:14.130532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb40b9-091a-4407-a1f0-044cfdf95f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:14.131010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb40b9-091a-4407-a1f0-044cfdf95f6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:14.144989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb40b9-091a-4407-a1f0-044cfdf95f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b6eb40b9-091a-4407-a1f0-044cfdf95f6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:14.154553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:14.156627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:14.157428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:14.159995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 184/367] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:44:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:14.161157 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb40b9-091a-4407-a1f0-044cfdf95f6f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:14.195873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4f1c8-ae7d-4f3f-b570-feeb8c46225b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:14.256149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9649e-179d-42e0-a994-314ac5d3a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:14.257033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9649e-179d-42e0-a994-314ac5d3a828 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:14.257324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9649e-179d-42e0-a994-314ac5d3a828 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:14.257608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9649e-179d-42e0-a994-314ac5d3a828 None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:14.259519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9649e-179d-42e0-a994-314ac5d3a828 None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:14.261055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9649e-179d-42e0-a994-314ac5d3a828 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:14.263001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 184/368] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:14 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:14.267974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9649e-179d-42e0-a994-314ac5d3a828 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:14.299341 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb40b9-091a-4407-a1f0-044cfdf95f6f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:14.308128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:14.338116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf61ef-034a-4f50-ba52-4321f9b210c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:14.339363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf61ef-034a-4f50-ba52-4321f9b210c1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:14.339859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf61ef-034a-4f50-ba52-4321f9b210c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:14.340339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf61ef-034a-4f50-ba52-4321f9b210c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:14.344133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:14.354891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf61ef-034a-4f50-ba52-4321f9b210c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-0caf61ef-034a-4f50-ba52-4321f9b210c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:14.364682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:14.365639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:14.366419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 185/369] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:44:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:14.367072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf61ef-034a-4f50-ba52-4321f9b210c1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:14.397529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9649e-179d-42e0-a994-314ac5d3a828 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:14.443441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1ed2a-98b5-4cf0-ba63-c0961818276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:14.444452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1ed2a-98b5-4cf0-ba63-c0961818276a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:14.444922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1ed2a-98b5-4cf0-ba63-c0961818276a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:14.445405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1ed2a-98b5-4cf0-ba63-c0961818276a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:14.446882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1ed2a-98b5-4cf0-ba63-c0961818276a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:14.447407 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1ed2a-98b5-4cf0-ba63-c0961818276a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:14.449024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1ed2a-98b5-4cf0-ba63-c0961818276a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:14.458113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 185/370] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:14.459268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1ed2a-98b5-4cf0-ba63-c0961818276a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:14.490302 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf61ef-034a-4f50-ba52-4321f9b210c1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:14.528601 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccec743-5d6e-454b-a233-568849b4d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:14.529326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccec743-5d6e-454b-a233-568849b4d73c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:14.529619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccec743-5d6e-454b-a233-568849b4d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:14.529899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccec743-5d6e-454b-a233-568849b4d73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:14.530852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccec743-5d6e-454b-a233-568849b4d73c None admin] RBAC: Adding query filter params (group.id=a7a286534cbc463d86f040d67c900a28, role.id=c78e303f11a84bcd80e78de27d7d26f2, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:14.531680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccec743-5d6e-454b-a233-568849b4d73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:14.533372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccec743-5d6e-454b-a233-568849b4d73c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:14.539591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 186/371] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jun 21 15:44:14 2022] GET /identity/v3/role_assignments?group.id=a7a286534cbc463d86f040d67c900a28&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:14.540564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccec743-5d6e-454b-a233-568849b4d73c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:14.587571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:14.594699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1ed2a-98b5-4cf0-ba63-c0961818276a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:14.635199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:14.656823 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e90fa-0492-4c05-81fb-23ecfba01576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:14.657888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e90fa-0492-4c05-81fb-23ecfba01576 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:14.659485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e90fa-0492-4c05-81fb-23ecfba01576 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:14.660797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e90fa-0492-4c05-81fb-23ecfba01576 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:14.661834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e90fa-0492-4c05-81fb-23ecfba01576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:14.663320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e90fa-0492-4c05-81fb-23ecfba01576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:14.668268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e90fa-0492-4c05-81fb-23ecfba01576 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:14.689630 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 186/372] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:14.697592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e90fa-0492-4c05-81fb-23ecfba01576 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:14.706570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccec743-5d6e-454b-a233-568849b4d73c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:14.789335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fb00c-ceeb-4016-9d3d-73998de55fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:14.791318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb00c-ceeb-4016-9d3d-73998de55fde None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:14.791834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb00c-ceeb-4016-9d3d-73998de55fde None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:14.792319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb00c-ceeb-4016-9d3d-73998de55fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:14.870171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e90fa-0492-4c05-81fb-23ecfba01576 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:14.876369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fb00c-ceeb-4016-9d3d-73998de55fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:14.877141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fb00c-ceeb-4016-9d3d-73998de55fde None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:14.914043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c5f86-e8b0-4cbe-b0ae-cffcc02df39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:14.915243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c5f86-e8b0-4cbe-b0ae-cffcc02df39c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:14.915757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c5f86-e8b0-4cbe-b0ae-cffcc02df39c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:14.916252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c5f86-e8b0-4cbe-b0ae-cffcc02df39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:14.919734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:15.028302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:15.055052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c5f86-e8b0-4cbe-b0ae-cffcc02df39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:15.057270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c5f86-e8b0-4cbe-b0ae-cffcc02df39c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:15.068312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 187/373] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:15.074522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fb00c-ceeb-4016-9d3d-73998de55fde None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:15.167153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 187/374] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:15.172295 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c5f86-e8b0-4cbe-b0ae-cffcc02df39c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:15.223630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fb00c-ceeb-4016-9d3d-73998de55fde None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:15.275478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:15.294083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed1ef9-b95e-4312-8192-1cbda4ab6be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:15.295148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed1ef9-b95e-4312-8192-1cbda4ab6be5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:15.295465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed1ef9-b95e-4312-8192-1cbda4ab6be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:15.295750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed1ef9-b95e-4312-8192-1cbda4ab6be5 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:15.297207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed1ef9-b95e-4312-8192-1cbda4ab6be5 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:15.298689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed1ef9-b95e-4312-8192-1cbda4ab6be5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:15.300897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 188/375] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:15 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:15.307253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed1ef9-b95e-4312-8192-1cbda4ab6be5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:15.323612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:15.333904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c5f86-e8b0-4cbe-b0ae-cffcc02df39c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:15.376187 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae8504-81fe-45c3-9bdd-68f8f5cb9ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:15.377185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae8504-81fe-45c3-9bdd-68f8f5cb9ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:15.377725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae8504-81fe-45c3-9bdd-68f8f5cb9ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:15.378013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae8504-81fe-45c3-9bdd-68f8f5cb9ac1 None admin] PATH_INFO: `/v3/projects/f406bc3b64324ae8acf4eaa5547534ca` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:15.379285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae8504-81fe-45c3-9bdd-68f8f5cb9ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=f406bc3b64324ae8acf4eaa5547534ca)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:15.380757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae8504-81fe-45c3-9bdd-68f8f5cb9ac1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:15.382654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 188/376] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:15 2022] GET /identity/v3/projects/f406bc3b64324ae8acf4eaa5547534ca => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:15.389600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae8504-81fe-45c3-9bdd-68f8f5cb9ac1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:15.504496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae8504-81fe-45c3-9bdd-68f8f5cb9ac1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:15.547378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326409a-0333-4087-8510-5fc3ea59cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:15.548509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326409a-0333-4087-8510-5fc3ea59cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:15.548806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326409a-0333-4087-8510-5fc3ea59cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:15.549188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326409a-0333-4087-8510-5fc3ea59cfe6 None admin] PATH_INFO: `/v3/groups/990a66f8a3bc4f0b8e7744e529538ac6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:15.557329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326409a-0333-4087-8510-5fc3ea59cfe6 None admin] RBAC: Authorizing `identity:get_group(group_id=990a66f8a3bc4f0b8e7744e529538ac6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:15.558131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed1ef9-b95e-4312-8192-1cbda4ab6be5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:15.565316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326409a-0333-4087-8510-5fc3ea59cfe6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:15.565316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 189/377] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:15 2022] GET /identity/v3/groups/990a66f8a3bc4f0b8e7744e529538ac6 => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:15.572763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326409a-0333-4087-8510-5fc3ea59cfe6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:15.603647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:15.633466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593bb96-52e3-456c-a427-3fc431d97051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:15.635092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593bb96-52e3-456c-a427-3fc431d97051 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:15.635555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593bb96-52e3-456c-a427-3fc431d97051 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:15.635841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593bb96-52e3-456c-a427-3fc431d97051 None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:15.637207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593bb96-52e3-456c-a427-3fc431d97051 None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:15.639011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593bb96-52e3-456c-a427-3fc431d97051 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:15.641103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 189/378] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:15 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:15.642508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b5e49-6f0f-45dc-bbb8-594c3339b6b4 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:15.642803 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b5e49-6f0f-45dc-bbb8-594c3339b6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:15.643085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b5e49-6f0f-45dc-bbb8-594c3339b6b4 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:15.644667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 190/379] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:15.650843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a3b55-1b08-493e-9d7c-2b336ecfa7bb None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:15.651139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a3b55-1b08-493e-9d7c-2b336ecfa7bb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:15.651468 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a3b55-1b08-493e-9d7c-2b336ecfa7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:15.670229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-538a3b55-1b08-493e-9d7c-2b336ecfa7bb None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:15.671527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-538a3b55-1b08-493e-9d7c-2b336ecfa7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:15.717855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326409a-0333-4087-8510-5fc3ea59cfe6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:15.744936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:15.757846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 191/380] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:15.758686 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a3b55-1b08-493e-9d7c-2b336ecfa7bb None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:15.759565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc8fe-78a7-45f6-b8fd-286c4e2aab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:15.760237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc8fe-78a7-45f6-b8fd-286c4e2aab03 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:15.760583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc8fe-78a7-45f6-b8fd-286c4e2aab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:15.760868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc8fe-78a7-45f6-b8fd-286c4e2aab03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:15.761721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc8fe-78a7-45f6-b8fd-286c4e2aab03 None admin] RBAC: Adding query filter params (group.id=990a66f8a3bc4f0b8e7744e529538ac6, role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=f406bc3b64324ae8acf4eaa5547534ca) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:15.762035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc8fe-78a7-45f6-b8fd-286c4e2aab03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:15.763796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc8fe-78a7-45f6-b8fd-286c4e2aab03 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:15.770197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 190/381] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jun 21 15:44:15 2022] GET /identity/v3/role_assignments?group.id=990a66f8a3bc4f0b8e7744e529538ac6&scope.project.id=f406bc3b64324ae8acf4eaa5547534ca&role.id=29dae918965d40bea71d83ffa2085316 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:15.815349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc8fe-78a7-45f6-b8fd-286c4e2aab03 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:15.881652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a3b55-1b08-493e-9d7c-2b336ecfa7bb None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:15.922765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce0412-8fb3-467d-8104-8cc9d43b81eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:15.923487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0412-8fb3-467d-8104-8cc9d43b81eb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:15.923779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0412-8fb3-467d-8104-8cc9d43b81eb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:15.924062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce0412-8fb3-467d-8104-8cc9d43b81eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:15.924943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce0412-8fb3-467d-8104-8cc9d43b81eb None admin] RBAC: Adding query filter params (group.id=a7a286534cbc463d86f040d67c900a28, role.id=8bd0b3ec424b423da0670486cc02bc49, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:15.925264 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce0412-8fb3-467d-8104-8cc9d43b81eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:15.926787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce0412-8fb3-467d-8104-8cc9d43b81eb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:15.942520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 192/382] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jun 21 15:44:15 2022] GET /identity/v3/role_assignments?group.id=a7a286534cbc463d86f040d67c900a28&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=8bd0b3ec424b423da0670486cc02bc49 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:15.970528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:16.003323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc8fe-78a7-45f6-b8fd-286c4e2aab03 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:16.051996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4208067-f70d-48f3-bd3a-51180f0a453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:16.052736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4208067-f70d-48f3-bd3a-51180f0a453c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:16.053025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4208067-f70d-48f3-bd3a-51180f0a453c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:16.053303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4208067-f70d-48f3-bd3a-51180f0a453c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:16.069271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4208067-f70d-48f3-bd3a-51180f0a453c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e4208067-f70d-48f3-bd3a-51180f0a453c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:16.077766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:16.080159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:16.082198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:16.083724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 191/383] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:16.086328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce0412-8fb3-467d-8104-8cc9d43b81eb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:16.187957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:16.239865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce0412-8fb3-467d-8104-8cc9d43b81eb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:16.282039 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f6cdd-6d2a-4ec3-b089-73190166ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:16.282725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f6cdd-6d2a-4ec3-b089-73190166ba62 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:16.283010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f6cdd-6d2a-4ec3-b089-73190166ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:16.283322 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f6cdd-6d2a-4ec3-b089-73190166ba62 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:16.284182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f6cdd-6d2a-4ec3-b089-73190166ba62 None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:16.284494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f6cdd-6d2a-4ec3-b089-73190166ba62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:16.285939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f6cdd-6d2a-4ec3-b089-73190166ba62 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:16.297584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 193/384] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:16.302271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4208067-f70d-48f3-bd3a-51180f0a453c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:16.411193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4208067-f70d-48f3-bd3a-51180f0a453c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:16.450075 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bd8be-a42b-417d-aacf-a0b8142e43af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:16.450961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bd8be-a42b-417d-aacf-a0b8142e43af None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:16.451274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bd8be-a42b-417d-aacf-a0b8142e43af None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:16.451556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bd8be-a42b-417d-aacf-a0b8142e43af None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:16.452770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bd8be-a42b-417d-aacf-a0b8142e43af None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:16.454220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bd8be-a42b-417d-aacf-a0b8142e43af None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:16.460601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 192/385] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:16 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:16.462209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f6cdd-6d2a-4ec3-b089-73190166ba62 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:16.469326 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb72ab-c0d4-4991-9669-c85929165e8c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:16.469614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb72ab-c0d4-4991-9669-c85929165e8c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:16.469905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb72ab-c0d4-4991-9669-c85929165e8c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:16.471646 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 193/386] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:16.476897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b233-b501-4ba4-ac2d-6470be350af6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:16.477200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b233-b501-4ba4-ac2d-6470be350af6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:16.477571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b233-b501-4ba4-ac2d-6470be350af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:16.513206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-eca1b233-b501-4ba4-ac2d-6470be350af6 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:16.514679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eca1b233-b501-4ba4-ac2d-6470be350af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:16.522303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:16.629135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f6cdd-6d2a-4ec3-b089-73190166ba62 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:16.656937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 194/387] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:16.659094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:16.674072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde02653-e4eb-44d6-990c-046c6a25225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:16.675327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde02653-e4eb-44d6-990c-046c6a25225f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:16.675822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde02653-e4eb-44d6-990c-046c6a25225f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:16.676301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde02653-e4eb-44d6-990c-046c6a25225f None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:16.677754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde02653-e4eb-44d6-990c-046c6a25225f None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:16.679447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde02653-e4eb-44d6-990c-046c6a25225f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:16.681520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 194/388] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:16 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:16.687611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1b233-b501-4ba4-ac2d-6470be350af6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:16.698610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde02653-e4eb-44d6-990c-046c6a25225f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:16.824445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde02653-e4eb-44d6-990c-046c6a25225f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:16.837022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1b233-b501-4ba4-ac2d-6470be350af6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:16.873060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a6ddd-9d75-467b-a298-634f01f44c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:16.874241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a6ddd-9d75-467b-a298-634f01f44c1a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:16.874754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a6ddd-9d75-467b-a298-634f01f44c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:16.875348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a6ddd-9d75-467b-a298-634f01f44c1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:16.895505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a6ddd-9d75-467b-a298-634f01f44c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-da3a6ddd-9d75-467b-a298-634f01f44c1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:16.906327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:16.907269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:16.908078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:16.912637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130e461-03f8-49e6-a310-580ab5ddfba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:16.913852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130e461-03f8-49e6-a310-580ab5ddfba3 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:16.914341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130e461-03f8-49e6-a310-580ab5ddfba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:16.914894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130e461-03f8-49e6-a310-580ab5ddfba3 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6/groups/a7a286534cbc463d86f040d67c900a28/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:16.917317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 195/389] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:44:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:16.918840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130e461-03f8-49e6-a310-580ab5ddfba3 None admin] RBAC: Authorizing `identity:create_grant(project_id=21ac6b9f65304534adce7421674442c6, group_id=a7a286534cbc463d86f040d67c900a28, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:16.920587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130e461-03f8-49e6-a310-580ab5ddfba3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:16.923886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a6ddd-9d75-467b-a298-634f01f44c1a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:16.943328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:16.950680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 195/390] 10.222.0.46 () {58 vars in 1442 bytes} [Tue Jun 21 15:44:16 2022] PUT /identity/v3/projects/21ac6b9f65304534adce7421674442c6/groups/a7a286534cbc463d86f040d67c900a28/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:44:16.997382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:17.057414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a6ddd-9d75-467b-a298-634f01f44c1a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:17.095597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02f483-5485-42b6-92a4-fe542c98de07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:17.096295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02f483-5485-42b6-92a4-fe542c98de07 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:17.096590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02f483-5485-42b6-92a4-fe542c98de07 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:17.096878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02f483-5485-42b6-92a4-fe542c98de07 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:17.097679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02f483-5485-42b6-92a4-fe542c98de07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:17.097998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02f483-5485-42b6-92a4-fe542c98de07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:17.099452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02f483-5485-42b6-92a4-fe542c98de07 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:17.110529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 196/391] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:17.120282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130e461-03f8-49e6-a310-580ab5ddfba3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:17.234173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130e461-03f8-49e6-a310-580ab5ddfba3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:17.272526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0445b5-28db-4117-8eb1-5268b0622c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:17.273396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0445b5-28db-4117-8eb1-5268b0622c6c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:17.273683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0445b5-28db-4117-8eb1-5268b0622c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:17.273962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0445b5-28db-4117-8eb1-5268b0622c6c None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:17.275722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0445b5-28db-4117-8eb1-5268b0622c6c None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:17.277289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0445b5-28db-4117-8eb1-5268b0622c6c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:17.279271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 196/392] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:17 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:17.288255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02f483-5485-42b6-92a4-fe542c98de07 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:17.402542 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02f483-5485-42b6-92a4-fe542c98de07 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:17.416788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:17.439275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81370afc-14e5-4dbe-9949-c36b63afc61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:17.440167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81370afc-14e5-4dbe-9949-c36b63afc61f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:17.440456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81370afc-14e5-4dbe-9949-c36b63afc61f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:17.440738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81370afc-14e5-4dbe-9949-c36b63afc61f None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:17.441968 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81370afc-14e5-4dbe-9949-c36b63afc61f None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:17.443471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81370afc-14e5-4dbe-9949-c36b63afc61f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:17.445517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 197/393] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:17 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:17.451382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0445b5-28db-4117-8eb1-5268b0622c6c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:17.516552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5639b4-1fbb-4353-9097-b091ea1d5515 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:17.516956 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5639b4-1fbb-4353-9097-b091ea1d5515 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:17.517245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5639b4-1fbb-4353-9097-b091ea1d5515 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:17.518910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 198/394] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:17.531981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2085e1-5cd6-4baf-a299-a6a40278e284 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:17.532268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2085e1-5cd6-4baf-a299-a6a40278e284 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:17.532562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2085e1-5cd6-4baf-a299-a6a40278e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:17.550153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:17.559661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5c2085e1-5cd6-4baf-a299-a6a40278e284 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:17.560889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5c2085e1-5cd6-4baf-a299-a6a40278e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:17.624642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0445b5-28db-4117-8eb1-5268b0622c6c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:17.689689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 199/395] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:17.703896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d775a-bc71-4f57-8909-70c09c75ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:17.704883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d775a-bc71-4f57-8909-70c09c75ac15 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:17.705164 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d775a-bc71-4f57-8909-70c09c75ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:17.705448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d775a-bc71-4f57-8909-70c09c75ac15 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6/groups/a7a286534cbc463d86f040d67c900a28/roles/8bd0b3ec424b423da0670486cc02bc49` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:17.707993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d775a-bc71-4f57-8909-70c09c75ac15 None admin] RBAC: Authorizing `identity:create_grant(project_id=21ac6b9f65304534adce7421674442c6, group_id=a7a286534cbc463d86f040d67c900a28, role_id=8bd0b3ec424b423da0670486cc02bc49)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:17.709558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d775a-bc71-4f57-8909-70c09c75ac15 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:17.718566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2085e1-5cd6-4baf-a299-a6a40278e284 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:17.729687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 197/396] 10.222.0.46 () {58 vars in 1442 bytes} [Tue Jun 21 15:44:17 2022] PUT /identity/v3/projects/21ac6b9f65304534adce7421674442c6/groups/a7a286534cbc463d86f040d67c900a28/roles/8bd0b3ec424b423da0670486cc02bc49 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:44:17.856296 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2085e1-5cd6-4baf-a299-a6a40278e284 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:17.869902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:17.905461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c292dc6-890e-49f9-a868-368ec5b1e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:17.906292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292dc6-890e-49f9-a868-368ec5b1e70b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:17.906588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292dc6-890e-49f9-a868-368ec5b1e70b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:17.906870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292dc6-890e-49f9-a868-368ec5b1e70b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:17.922836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c292dc6-890e-49f9-a868-368ec5b1e70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-4c292dc6-890e-49f9-a868-368ec5b1e70b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:17.932047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:17.932934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:17.933804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 200/397] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:17.943188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d775a-bc71-4f57-8909-70c09c75ac15 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:18.077332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d775a-bc71-4f57-8909-70c09c75ac15 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:18.112451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:18.117839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2ed7d-0ca3-400d-8b31-586e777f8f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:18.119428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ed7d-0ca3-400d-8b31-586e777f8f32 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:18.119927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ed7d-0ca3-400d-8b31-586e777f8f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:18.120430 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2ed7d-0ca3-400d-8b31-586e777f8f32 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:18.121423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2ed7d-0ca3-400d-8b31-586e777f8f32 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:18.122088 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2ed7d-0ca3-400d-8b31-586e777f8f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:18.123941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2ed7d-0ca3-400d-8b31-586e777f8f32 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:18.133370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 198/398] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:18.140029 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c292dc6-890e-49f9-a868-368ec5b1e70b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:18.265724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c292dc6-890e-49f9-a868-368ec5b1e70b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:18.314631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e5125-a662-4785-b86b-74d8c212f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:18.315531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e5125-a662-4785-b86b-74d8c212f0ac None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:18.315828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e5125-a662-4785-b86b-74d8c212f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:18.316110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e5125-a662-4785-b86b-74d8c212f0ac None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:18.319881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e5125-a662-4785-b86b-74d8c212f0ac None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:18.321431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e5125-a662-4785-b86b-74d8c212f0ac None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:18.323584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 201/399] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:18 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:18.329136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2ed7d-0ca3-400d-8b31-586e777f8f32 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:18.530256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2ed7d-0ca3-400d-8b31-586e777f8f32 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:18.579323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5b084-6491-4e3a-82bd-a2d8e8c7d7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:18.580199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b084-6491-4e3a-82bd-a2d8e8c7d7bd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:18.580486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b084-6491-4e3a-82bd-a2d8e8c7d7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:18.580765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b084-6491-4e3a-82bd-a2d8e8c7d7bd None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:18.588011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5b084-6491-4e3a-82bd-a2d8e8c7d7bd None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:18.589492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5b084-6491-4e3a-82bd-a2d8e8c7d7bd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:18.591312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 199/400] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:18 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:18.597177 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e5125-a662-4785-b86b-74d8c212f0ac None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:18.650446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:18.734614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e5125-a662-4785-b86b-74d8c212f0ac None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:18.783193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0bde2-ec21-4435-af29-a3be3b0aaa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:18.784010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0bde2-ec21-4435-af29-a3be3b0aaa64 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:18.784296 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0bde2-ec21-4435-af29-a3be3b0aaa64 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:18.784578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0bde2-ec21-4435-af29-a3be3b0aaa64 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/groups/a7a286534cbc463d86f040d67c900a28/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:18.792543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0bde2-ec21-4435-af29-a3be3b0aaa64 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fa16d1165e84f94bf8fc56809c2564f, group_id=a7a286534cbc463d86f040d67c900a28, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:18.794041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0bde2-ec21-4435-af29-a3be3b0aaa64 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:18.808575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 202/401] 10.222.0.46 () {58 vars in 1442 bytes} [Tue Jun 21 15:44:18 2022] PUT /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/groups/a7a286534cbc463d86f040d67c900a28/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:44:18.884361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3507-3677-4f36-be0f-2284c6bdb2db None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:18.884675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3507-3677-4f36-be0f-2284c6bdb2db None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:18.884953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3507-3677-4f36-be0f-2284c6bdb2db None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:18.886493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 200/402] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:18.892373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb65594-6e7c-4eea-b065-1252a7acbb66 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:18.893336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb65594-6e7c-4eea-b065-1252a7acbb66 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:18.893813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb65594-6e7c-4eea-b065-1252a7acbb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:18.920514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1eb65594-6e7c-4eea-b065-1252a7acbb66 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:18.921773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1eb65594-6e7c-4eea-b065-1252a7acbb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:19.028272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 203/403] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:19.034242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f2b7f-dca0-493c-ab17-152dfbf7e62e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:19.034704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f2b7f-dca0-493c-ab17-152dfbf7e62e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:19.035139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f2b7f-dca0-493c-ab17-152dfbf7e62e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:19.039456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 201/404] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:19.047349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d723ba-240e-4342-b5cc-277f5e0b5e6d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:19.047857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d723ba-240e-4342-b5cc-277f5e0b5e6d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:19.048366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d723ba-240e-4342-b5cc-277f5e0b5e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:19.054708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f2b7f-dca0-493c-ab17-152dfbf7e62e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:19.077329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-80d723ba-240e-4342-b5cc-277f5e0b5e6d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:19.079224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-80d723ba-240e-4342-b5cc-277f5e0b5e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:19.123151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:19.140388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:19.178664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f2b7f-dca0-493c-ab17-152dfbf7e62e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:19.215313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 204/405] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:19.217632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d0232-f478-4b8e-a54e-fa8d98d88504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:19.218774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d0232-f478-4b8e-a54e-fa8d98d88504 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:19.219334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d0232-f478-4b8e-a54e-fa8d98d88504 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:19.219845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d0232-f478-4b8e-a54e-fa8d98d88504 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:19.232247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d0232-f478-4b8e-a54e-fa8d98d88504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-dd6d0232-f478-4b8e-a54e-fa8d98d88504 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:19.240969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:19.241903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:19.242690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:19.246268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 202/406] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:44:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:19.252418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d0232-f478-4b8e-a54e-fa8d98d88504 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:19.252572 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d723ba-240e-4342-b5cc-277f5e0b5e6d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:19.378537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d0232-f478-4b8e-a54e-fa8d98d88504 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:19.415871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:19.443956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61900d77-ab12-4c26-8c40-7305765ba3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:19.444698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900d77-ab12-4c26-8c40-7305765ba3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:19.444987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900d77-ab12-4c26-8c40-7305765ba3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:19.445292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900d77-ab12-4c26-8c40-7305765ba3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:19.446586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61900d77-ab12-4c26-8c40-7305765ba3a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:19.446586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61900d77-ab12-4c26-8c40-7305765ba3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:19.448223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61900d77-ab12-4c26-8c40-7305765ba3a5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:19.473297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 203/407] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:19.475647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61900d77-ab12-4c26-8c40-7305765ba3a5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:19.478461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d723ba-240e-4342-b5cc-277f5e0b5e6d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:19.586292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61900d77-ab12-4c26-8c40-7305765ba3a5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:19.589059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1ed81-7507-49c0-9052-8c8ad4728275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:19.589892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ed81-7507-49c0-9052-8c8ad4728275 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:19.590192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ed81-7507-49c0-9052-8c8ad4728275 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:19.590569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ed81-7507-49c0-9052-8c8ad4728275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:19.618941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1ed81-7507-49c0-9052-8c8ad4728275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:19.626363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10896c-5d8c-4e39-8903-f795a0cbb060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-dbc1ed81-7507-49c0-9052-8c8ad4728275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:19.626844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:19.628444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:19.630059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:19.632166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10896c-5d8c-4e39-8903-f795a0cbb060 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:19.632166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10896c-5d8c-4e39-8903-f795a0cbb060 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:19.632166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10896c-5d8c-4e39-8903-f795a0cbb060 None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:19.632166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10896c-5d8c-4e39-8903-f795a0cbb060 None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:19.632166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10896c-5d8c-4e39-8903-f795a0cbb060 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:19.633329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 204/408] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:19 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:19.639334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 205/409] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:19.639492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10896c-5d8c-4e39-8903-f795a0cbb060 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:19.648177 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1ed81-7507-49c0-9052-8c8ad4728275 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:19.698244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:19.707539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:19.750796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10896c-5d8c-4e39-8903-f795a0cbb060 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:19.786284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ba80-d874-424e-b657-c110cd423027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:19.787693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ba80-d874-424e-b657-c110cd423027 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:19.788352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ba80-d874-424e-b657-c110cd423027 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:19.788778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ba80-d874-424e-b657-c110cd423027 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:19.790692 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524ba80-d874-424e-b657-c110cd423027 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:19.792318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524ba80-d874-424e-b657-c110cd423027 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:19.794478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 205/410] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:19 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:19.800136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ba80-d874-424e-b657-c110cd423027 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:19.882856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1ed81-7507-49c0-9052-8c8ad4728275 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:19.933148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ba80-d874-424e-b657-c110cd423027 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:19.942739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23eab7-1cbf-43b0-b5a8-1af5cfc98cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:19.944060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23eab7-1cbf-43b0-b5a8-1af5cfc98cfc None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:19.944530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23eab7-1cbf-43b0-b5a8-1af5cfc98cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:19.944990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23eab7-1cbf-43b0-b5a8-1af5cfc98cfc None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:19.946453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23eab7-1cbf-43b0-b5a8-1af5cfc98cfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:19.947027 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23eab7-1cbf-43b0-b5a8-1af5cfc98cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:19.948831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23eab7-1cbf-43b0-b5a8-1af5cfc98cfc None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:19.949974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:19.960506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 206/411] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:19.962339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cbc31-30ad-46ed-ab99-a9d15787c8be None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:19.962992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cbc31-30ad-46ed-ab99-a9d15787c8be None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:19.963715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cbc31-30ad-46ed-ab99-a9d15787c8be None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:19.965827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 207/412] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:19.967244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cbc31-30ad-46ed-ab99-a9d15787c8be None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:19.976119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748278c-3e70-4e5d-9cc1-ff6238b84f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:19.977023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748278c-3e70-4e5d-9cc1-ff6238b84f60 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:19.977839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748278c-3e70-4e5d-9cc1-ff6238b84f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:19.978795 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748278c-3e70-4e5d-9cc1-ff6238b84f60 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/groups/a7a286534cbc463d86f040d67c900a28/roles/8bd0b3ec424b423da0670486cc02bc49` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:19.981864 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748278c-3e70-4e5d-9cc1-ff6238b84f60 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fa16d1165e84f94bf8fc56809c2564f, group_id=a7a286534cbc463d86f040d67c900a28, role_id=8bd0b3ec424b423da0670486cc02bc49)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:19.984297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748278c-3e70-4e5d-9cc1-ff6238b84f60 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:20.003783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 206/413] 10.222.0.46 () {58 vars in 1442 bytes} [Tue Jun 21 15:44:19 2022] PUT /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f/groups/a7a286534cbc463d86f040d67c900a28/roles/8bd0b3ec424b423da0670486cc02bc49 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:44:20.011350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43ef4-d3b6-4319-ba3e-85dcd25d27dd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:20.011350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43ef4-d3b6-4319-ba3e-85dcd25d27dd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:20.011350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43ef4-d3b6-4319-ba3e-85dcd25d27dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:20.051824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2cc43ef4-d3b6-4319-ba3e-85dcd25d27dd None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:20.056210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cc43ef4-d3b6-4319-ba3e-85dcd25d27dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:20.137848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:20.163569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cbc31-30ad-46ed-ab99-a9d15787c8be None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:20.208720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37e4b6-b55b-4967-be19-f01284c2f2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:20.210399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37e4b6-b55b-4967-be19-f01284c2f2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:20.210834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37e4b6-b55b-4967-be19-f01284c2f2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:20.211312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37e4b6-b55b-4967-be19-f01284c2f2c1 None admin] PATH_INFO: `/v3/groups/990a66f8a3bc4f0b8e7744e529538ac6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:20.213591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37e4b6-b55b-4967-be19-f01284c2f2c1 None admin] RBAC: Authorizing `identity:get_group(group_id=990a66f8a3bc4f0b8e7744e529538ac6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:20.214898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 207/414] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:20.215395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37e4b6-b55b-4967-be19-f01284c2f2c1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:20.217260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 208/415] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:19 2022] GET /identity/v3/groups/990a66f8a3bc4f0b8e7744e529538ac6 => generated 229 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:20.222934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43ef4-d3b6-4319-ba3e-85dcd25d27dd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:20.240051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37e4b6-b55b-4967-be19-f01284c2f2c1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:20.388434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37e4b6-b55b-4967-be19-f01284c2f2c1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:20.393484 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43ef4-d3b6-4319-ba3e-85dcd25d27dd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:20.410686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:20.457897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714419-ea65-45e7-b8c4-60ea684c829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:20.458744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714419-ea65-45e7-b8c4-60ea684c829a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:20.459032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714419-ea65-45e7-b8c4-60ea684c829a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:20.459343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714419-ea65-45e7-b8c4-60ea684c829a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:20.465402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3321fec-d893-4a29-ba97-2f6799993537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:20.466298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3321fec-d893-4a29-ba97-2f6799993537 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:20.466582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3321fec-d893-4a29-ba97-2f6799993537 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:20.466857 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3321fec-d893-4a29-ba97-2f6799993537 None admin] PATH_INFO: `/v3/projects/f406bc3b64324ae8acf4eaa5547534ca` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:20.468698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3321fec-d893-4a29-ba97-2f6799993537 None admin] RBAC: Authorizing `identity:get_project(project_id=f406bc3b64324ae8acf4eaa5547534ca)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:20.470184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3321fec-d893-4a29-ba97-2f6799993537 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:20.472377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 208/416] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:20 2022] GET /identity/v3/projects/f406bc3b64324ae8acf4eaa5547534ca => generated 344 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:20.480099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3321fec-d893-4a29-ba97-2f6799993537 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:20.502977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd714419-ea65-45e7-b8c4-60ea684c829a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-dd714419-ea65-45e7-b8c4-60ea684c829a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:20.513175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:20.514399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:20.515232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:20.527654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 209/417] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:20.536944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714419-ea65-45e7-b8c4-60ea684c829a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:20.556709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:20.649401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3321fec-d893-4a29-ba97-2f6799993537 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:20.704425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714419-ea65-45e7-b8c4-60ea684c829a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:20.706845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f81d1a-dcea-4c5d-b31e-2764cf0e6002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:20.709073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81d1a-dcea-4c5d-b31e-2764cf0e6002 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:20.709370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81d1a-dcea-4c5d-b31e-2764cf0e6002 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:20.709655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81d1a-dcea-4c5d-b31e-2764cf0e6002 None admin] PATH_INFO: `/v3/projects/f406bc3b64324ae8acf4eaa5547534ca/groups/990a66f8a3bc4f0b8e7744e529538ac6/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:20.714195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f81d1a-dcea-4c5d-b31e-2764cf0e6002 None admin] RBAC: Authorizing `identity:create_grant(project_id=f406bc3b64324ae8acf4eaa5547534ca, group_id=990a66f8a3bc4f0b8e7744e529538ac6, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:20.715816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f81d1a-dcea-4c5d-b31e-2764cf0e6002 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:20.733153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 209/418] 10.222.0.46 () {58 vars in 1442 bytes} [Tue Jun 21 15:44:20 2022] PUT /identity/v3/projects/f406bc3b64324ae8acf4eaa5547534ca/groups/990a66f8a3bc4f0b8e7744e529538ac6/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:44:20.734803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9d4c9-1182-4912-8ea1-c3cf3bcadbd8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:20.739230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9d4c9-1182-4912-8ea1-c3cf3bcadbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:20.739230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9d4c9-1182-4912-8ea1-c3cf3bcadbd8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:20.739230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 210/419] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:20.742680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72b1c1-b5fd-4dbb-808c-db1622261500 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:20.744456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72b1c1-b5fd-4dbb-808c-db1622261500 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:20.744932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72b1c1-b5fd-4dbb-808c-db1622261500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:20.777640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-da72b1c1-b5fd-4dbb-808c-db1622261500 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:20.779119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da72b1c1-b5fd-4dbb-808c-db1622261500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:20.783920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f3f7e-a6d0-45c4-bec9-125d001a8ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:20.784623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f3f7e-a6d0-45c4-bec9-125d001a8ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:20.784916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f3f7e-a6d0-45c4-bec9-125d001a8ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:20.785199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f3f7e-a6d0-45c4-bec9-125d001a8ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:20.785975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f3f7e-a6d0-45c4-bec9-125d001a8ac6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:20.786291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f3f7e-a6d0-45c4-bec9-125d001a8ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:20.787724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f3f7e-a6d0-45c4-bec9-125d001a8ac6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:20.812042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 210/420] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:20.817751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f3f7e-a6d0-45c4-bec9-125d001a8ac6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:20.831887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:20.917137 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 211/421] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:20.952853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:20.958135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72b1c1-b5fd-4dbb-808c-db1622261500 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:20.993469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f3f7e-a6d0-45c4-bec9-125d001a8ac6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:21.062326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebf025-6dc8-4652-a667-3547029c9114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:21.062993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebf025-6dc8-4652-a667-3547029c9114 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:21.063366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebf025-6dc8-4652-a667-3547029c9114 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:21.063651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebf025-6dc8-4652-a667-3547029c9114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:21.129346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72b1c1-b5fd-4dbb-808c-db1622261500 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:21.168510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebf025-6dc8-4652-a667-3547029c9114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:21.169921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebf025-6dc8-4652-a667-3547029c9114 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:21.247336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:21.264152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47131f0-3028-4ef2-9158-00ad26a224b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:21.264998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47131f0-3028-4ef2-9158-00ad26a224b8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:21.265288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47131f0-3028-4ef2-9158-00ad26a224b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:21.265573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47131f0-3028-4ef2-9158-00ad26a224b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:21.287026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 211/422] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 15:44:21.296682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebf025-6dc8-4652-a667-3547029c9114 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:21.299677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47131f0-3028-4ef2-9158-00ad26a224b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f47131f0-3028-4ef2-9158-00ad26a224b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:21.314230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:21.315178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:21.315959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:21.320705 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 212/423] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:44:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:21.328166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47131f0-3028-4ef2-9158-00ad26a224b8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:21.362709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:21.455337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebf025-6dc8-4652-a667-3547029c9114 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:21.456898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47131f0-3028-4ef2-9158-00ad26a224b8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:21.494361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687e7c1-1458-4964-8a43-17238440434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:21.495665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687e7c1-1458-4964-8a43-17238440434a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:21.496149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687e7c1-1458-4964-8a43-17238440434a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:21.496620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687e7c1-1458-4964-8a43-17238440434a None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:21.498222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687e7c1-1458-4964-8a43-17238440434a None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:21.500392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687e7c1-1458-4964-8a43-17238440434a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:21.500951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f686f-1a44-4726-9a14-0a46cb88b76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:21.501625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f686f-1a44-4726-9a14-0a46cb88b76d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:21.501918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f686f-1a44-4726-9a14-0a46cb88b76d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:21.502205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f686f-1a44-4726-9a14-0a46cb88b76d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:21.502973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f686f-1a44-4726-9a14-0a46cb88b76d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:21.503325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f686f-1a44-4726-9a14-0a46cb88b76d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:21.508135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f686f-1a44-4726-9a14-0a46cb88b76d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:21.508469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 212/424] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:21 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:21.510082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a822c-4e8c-447e-8c60-eb90fe0620df None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:21.510572 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a822c-4e8c-447e-8c60-eb90fe0620df None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:21.511061 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a822c-4e8c-447e-8c60-eb90fe0620df None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:21.512575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 213/425] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:21.513449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a822c-4e8c-447e-8c60-eb90fe0620df None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:21.520145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 213/426] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:21.521504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed58e-b5ac-4b5a-b56d-5a0af53e6131 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:21.521808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed58e-b5ac-4b5a-b56d-5a0af53e6131 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:21.522097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed58e-b5ac-4b5a-b56d-5a0af53e6131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:21.545801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cc3ed58e-b5ac-4b5a-b56d-5a0af53e6131 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:21.547000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cc3ed58e-b5ac-4b5a-b56d-5a0af53e6131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:21.574437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:21.631199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 214/427] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:21.631199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ed58e-b5ac-4b5a-b56d-5a0af53e6131 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:21.655374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:21.677667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a822c-4e8c-447e-8c60-eb90fe0620df None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:21.725980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af339d66-2b8b-4ec7-9472-239a12e69b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:21.727688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af339d66-2b8b-4ec7-9472-239a12e69b59 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:21.728599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af339d66-2b8b-4ec7-9472-239a12e69b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:21.729366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af339d66-2b8b-4ec7-9472-239a12e69b59 None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:21.731063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af339d66-2b8b-4ec7-9472-239a12e69b59 None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:21.733522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af339d66-2b8b-4ec7-9472-239a12e69b59 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:21.736478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 214/428] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:21 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:21.737455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af339d66-2b8b-4ec7-9472-239a12e69b59 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:21.756991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ed58e-b5ac-4b5a-b56d-5a0af53e6131 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:21.795425 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50fa8d-7e78-401b-9472-68f6962cd87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:21.796090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fa8d-7e78-401b-9472-68f6962cd87f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:21.796381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fa8d-7e78-401b-9472-68f6962cd87f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:21.796671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fa8d-7e78-401b-9472-68f6962cd87f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:21.870973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50fa8d-7e78-401b-9472-68f6962cd87f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:21.872518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50fa8d-7e78-401b-9472-68f6962cd87f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:21.884471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af339d66-2b8b-4ec7-9472-239a12e69b59 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:21.893238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:21.894854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:21.925876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505633b6-41e0-4acf-a25b-e28fd075d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:21.926087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505633b6-41e0-4acf-a25b-e28fd075d75e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:21.926305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505633b6-41e0-4acf-a25b-e28fd075d75e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:21.926522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505633b6-41e0-4acf-a25b-e28fd075d75e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:21.938927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505633b6-41e0-4acf-a25b-e28fd075d75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-505633b6-41e0-4acf-a25b-e28fd075d75e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:21.947444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:21.948360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:44:21.949152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:21.953882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 215/429] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:21.954732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505633b6-41e0-4acf-a25b-e28fd075d75e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:22.020623 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 215/430] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:22.021511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50fa8d-7e78-401b-9472-68f6962cd87f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:22.069961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505633b6-41e0-4acf-a25b-e28fd075d75e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:22.117135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209280c-2f39-43e2-9d37-9faf26f3f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:22.118484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209280c-2f39-43e2-9d37-9faf26f3f520 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:22.119349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209280c-2f39-43e2-9d37-9faf26f3f520 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:22.119676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209280c-2f39-43e2-9d37-9faf26f3f520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:22.120995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209280c-2f39-43e2-9d37-9faf26f3f520 None admin] RBAC: Adding query filter params (group.id=a7a286534cbc463d86f040d67c900a28, role.id=c78e303f11a84bcd80e78de27d7d26f2, scope.project.id=21ac6b9f65304534adce7421674442c6) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:22.121326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209280c-2f39-43e2-9d37-9faf26f3f520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:22.123193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209280c-2f39-43e2-9d37-9faf26f3f520 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:22.131674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 216/431] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jun 21 15:44:21 2022] GET /identity/v3/role_assignments?group.id=a7a286534cbc463d86f040d67c900a28&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:22.133089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209280c-2f39-43e2-9d37-9faf26f3f520 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:22.149788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50fa8d-7e78-401b-9472-68f6962cd87f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:22.171403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:22.192374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:22.224911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ff91f-be25-44f5-9e86-364bbf6426b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:22.226772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ff91f-be25-44f5-9e86-364bbf6426b3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:22.229400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ff91f-be25-44f5-9e86-364bbf6426b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:22.229861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ff91f-be25-44f5-9e86-364bbf6426b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:22.230811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ff91f-be25-44f5-9e86-364bbf6426b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:22.231383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ff91f-be25-44f5-9e86-364bbf6426b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:22.233161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ff91f-be25-44f5-9e86-364bbf6426b3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:22.253550 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 216/432] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:44:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:22.260769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ff91f-be25-44f5-9e86-364bbf6426b3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:22.350816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209280c-2f39-43e2-9d37-9faf26f3f520 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:22.386371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ff91f-be25-44f5-9e86-364bbf6426b3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:22.398172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88475542-846c-4864-953f-ab55cbcca200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:22.400334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88475542-846c-4864-953f-ab55cbcca200 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:22.400334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88475542-846c-4864-953f-ab55cbcca200 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:22.400508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88475542-846c-4864-953f-ab55cbcca200 None admin] PATH_INFO: `/v3/projects/21ac6b9f65304534adce7421674442c6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:22.402158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88475542-846c-4864-953f-ab55cbcca200 None admin] RBAC: Authorizing `identity:get_project(project_id=21ac6b9f65304534adce7421674442c6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:22.403661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88475542-846c-4864-953f-ab55cbcca200 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:22.405596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 217/433] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:22 2022] GET /identity/v3/projects/21ac6b9f65304534adce7421674442c6 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:22.406651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b5e0-64e8-482f-b321-8b5d34c7b512 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:22.411627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b5e0-64e8-482f-b321-8b5d34c7b512 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:22.411932 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b5e0-64e8-482f-b321-8b5d34c7b512 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:22.413317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 218/434] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:22.414053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48b5e0-64e8-482f-b321-8b5d34c7b512 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:22.438394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed3ef-9e98-43ec-b3d2-4e4b8d4ce62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:22.439101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed3ef-9e98-43ec-b3d2-4e4b8d4ce62f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:22.439418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed3ef-9e98-43ec-b3d2-4e4b8d4ce62f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:22.439705 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed3ef-9e98-43ec-b3d2-4e4b8d4ce62f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:22.496524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:22.537047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ed3ef-9e98-43ec-b3d2-4e4b8d4ce62f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:22.540600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ed3ef-9e98-43ec-b3d2-4e4b8d4ce62f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:22.556523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:22.562295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48b5e0-64e8-482f-b321-8b5d34c7b512 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:22.615259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509947e-d510-47ea-a676-17fcd7646f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:22.616055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509947e-d510-47ea-a676-17fcd7646f56 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:22.616350 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509947e-d510-47ea-a676-17fcd7646f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:22.616635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509947e-d510-47ea-a676-17fcd7646f56 None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:22.618528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509947e-d510-47ea-a676-17fcd7646f56 None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:22.620397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509947e-d510-47ea-a676-17fcd7646f56 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:22.622293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 219/435] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:22 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:22.624214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757dee2-40df-48ba-96da-03e630ed1c81 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:22.624214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757dee2-40df-48ba-96da-03e630ed1c81 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:22.624214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757dee2-40df-48ba-96da-03e630ed1c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:22.650167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4757dee2-40df-48ba-96da-03e630ed1c81 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:22.651468 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4757dee2-40df-48ba-96da-03e630ed1c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:22.692743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 217/436] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:22.693602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed3ef-9e98-43ec-b3d2-4e4b8d4ce62f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:22.739346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 220/437] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:22.739346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757dee2-40df-48ba-96da-03e630ed1c81 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:22.797166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:22.824434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed3ef-9e98-43ec-b3d2-4e4b8d4ce62f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:22.845707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:22.852615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757dee2-40df-48ba-96da-03e630ed1c81 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:22.864240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98836e-13b4-4f70-9397-6d0357b2a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:22.864899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98836e-13b4-4f70-9397-6d0357b2a181 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:22.865550 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98836e-13b4-4f70-9397-6d0357b2a181 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:22.865788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98836e-13b4-4f70-9397-6d0357b2a181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:22.866664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98836e-13b4-4f70-9397-6d0357b2a181 None admin] RBAC: Adding query filter params (group.id=a7a286534cbc463d86f040d67c900a28, role.id=8bd0b3ec424b423da0670486cc02bc49, scope.project.id=21ac6b9f65304534adce7421674442c6) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:22.866958 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98836e-13b4-4f70-9397-6d0357b2a181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:22.868461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98836e-13b4-4f70-9397-6d0357b2a181 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:22.874676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 218/438] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jun 21 15:44:22 2022] GET /identity/v3/role_assignments?group.id=a7a286534cbc463d86f040d67c900a28&scope.project.id=21ac6b9f65304534adce7421674442c6&role.id=8bd0b3ec424b423da0670486cc02bc49 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:22.875495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98836e-13b4-4f70-9397-6d0357b2a181 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:22.903919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247a50-7e3f-438c-ae7f-8e1a0ca77867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:22.905151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247a50-7e3f-438c-ae7f-8e1a0ca77867 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:22.905613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247a50-7e3f-438c-ae7f-8e1a0ca77867 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:22.906146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247a50-7e3f-438c-ae7f-8e1a0ca77867 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:22.907765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247a50-7e3f-438c-ae7f-8e1a0ca77867 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:22.909459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247a50-7e3f-438c-ae7f-8e1a0ca77867 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:22.911674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 221/439] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:22 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:22.918571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247a50-7e3f-438c-ae7f-8e1a0ca77867 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:23.021340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98836e-13b4-4f70-9397-6d0357b2a181 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:23.059454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247a50-7e3f-438c-ae7f-8e1a0ca77867 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:23.069917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf5808-4419-406e-a39b-7ed67db44be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:23.073518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf5808-4419-406e-a39b-7ed67db44be8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.073518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf5808-4419-406e-a39b-7ed67db44be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.073518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf5808-4419-406e-a39b-7ed67db44be8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.087465 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:23.089591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf5808-4419-406e-a39b-7ed67db44be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-25bf5808-4419-406e-a39b-7ed67db44be8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:23.102868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:23.104009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:23.104781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 219/440] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:44:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:23.107755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf5808-4419-406e-a39b-7ed67db44be8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:23.116645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec21b0-8723-4e9a-a7d7-179a0c2a6961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:23.118528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec21b0-8723-4e9a-a7d7-179a0c2a6961 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.118528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec21b0-8723-4e9a-a7d7-179a0c2a6961 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.118528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec21b0-8723-4e9a-a7d7-179a0c2a6961 None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.119733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec21b0-8723-4e9a-a7d7-179a0c2a6961 None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:23.121182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec21b0-8723-4e9a-a7d7-179a0c2a6961 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:23.123121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 222/441] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:22 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:23.124420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32704-e232-47bd-80ee-d186b2439aa8 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.124716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32704-e232-47bd-80ee-d186b2439aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.124984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32704-e232-47bd-80ee-d186b2439aa8 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.126379 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 223/442] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:23.130906 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c32704-e232-47bd-80ee-d186b2439aa8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:23.166633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:23.244993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf5808-4419-406e-a39b-7ed67db44be8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:23.255985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c32704-e232-47bd-80ee-d186b2439aa8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:23.278681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b0337-b16c-4899-b816-294d5f8629cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:23.279378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b0337-b16c-4899-b816-294d5f8629cc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.279665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b0337-b16c-4899-b816-294d5f8629cc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.279941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b0337-b16c-4899-b816-294d5f8629cc None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.280690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b0337-b16c-4899-b816-294d5f8629cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:23.281000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b0337-b16c-4899-b816-294d5f8629cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:23.282391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b0337-b16c-4899-b816-294d5f8629cc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:23.291087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 220/443] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:23.293311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1a895-7334-4bba-9069-d40dcabc1892 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.293605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1a895-7334-4bba-9069-d40dcabc1892 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.293883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1a895-7334-4bba-9069-d40dcabc1892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.300199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d254c-3147-417a-bbad-3ffaa5a95d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:23.300874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d254c-3147-417a-bbad-3ffaa5a95d6f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.301160 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d254c-3147-417a-bbad-3ffaa5a95d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.301441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d254c-3147-417a-bbad-3ffaa5a95d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.302287 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d254c-3147-417a-bbad-3ffaa5a95d6f None admin] RBAC: Adding query filter params (group.id=a7a286534cbc463d86f040d67c900a28, role.id=c78e303f11a84bcd80e78de27d7d26f2, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:23.302609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d254c-3147-417a-bbad-3ffaa5a95d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:23.304150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d254c-3147-417a-bbad-3ffaa5a95d6f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:23.311886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 224/444] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jun 21 15:44:23 2022] GET /identity/v3/role_assignments?group.id=a7a286534cbc463d86f040d67c900a28&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=c78e303f11a84bcd80e78de27d7d26f2 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:23.314176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0cd1a895-7334-4bba-9069-d40dcabc1892 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:23.315434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0cd1a895-7334-4bba-9069-d40dcabc1892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:23.320316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d254c-3147-417a-bbad-3ffaa5a95d6f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:23.383459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:23.399135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 221/445] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:23.422715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1a895-7334-4bba-9069-d40dcabc1892 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:23.440921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:23.448632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d254c-3147-417a-bbad-3ffaa5a95d6f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:23.488843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6b10f-be02-4750-88eb-8be3ea27d913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:23.489495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6b10f-be02-4750-88eb-8be3ea27d913 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.489784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6b10f-be02-4750-88eb-8be3ea27d913 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.490065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6b10f-be02-4750-88eb-8be3ea27d913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.553223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1a895-7334-4bba-9069-d40dcabc1892 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:23.580065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6b10f-be02-4750-88eb-8be3ea27d913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:23.581564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6b10f-be02-4750-88eb-8be3ea27d913 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:23.595956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f65d66-67fb-47c7-a48e-0b5e07be0afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:23.597054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f65d66-67fb-47c7-a48e-0b5e07be0afc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.597523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f65d66-67fb-47c7-a48e-0b5e07be0afc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.597807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f65d66-67fb-47c7-a48e-0b5e07be0afc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.614498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f65d66-67fb-47c7-a48e-0b5e07be0afc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e1f65d66-67fb-47c7-a48e-0b5e07be0afc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:23.622698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:23.623929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:23.624701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 222/446] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:44:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:23.630395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f65d66-67fb-47c7-a48e-0b5e07be0afc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:23.696707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:23.701573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:23.708907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 225/447] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:23.714431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6b10f-be02-4750-88eb-8be3ea27d913 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:23.749940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f65d66-67fb-47c7-a48e-0b5e07be0afc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:23.784638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8fa1e-08eb-4c7b-b211-d08ab0cbb3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:23.785299 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8fa1e-08eb-4c7b-b211-d08ab0cbb3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.785587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8fa1e-08eb-4c7b-b211-d08ab0cbb3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.785872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8fa1e-08eb-4c7b-b211-d08ab0cbb3f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.786608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8fa1e-08eb-4c7b-b211-d08ab0cbb3f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:23.786916 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8fa1e-08eb-4c7b-b211-d08ab0cbb3f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:23.788326 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8fa1e-08eb-4c7b-b211-d08ab0cbb3f4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:23.797125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 223/448] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:23.802639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8fa1e-08eb-4c7b-b211-d08ab0cbb3f4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:23.819236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6b10f-be02-4750-88eb-8be3ea27d913 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:23.855422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47a725-188f-43e7-88c3-be7d5d672520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:23.856295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47a725-188f-43e7-88c3-be7d5d672520 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.856579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47a725-188f-43e7-88c3-be7d5d672520 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.856854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47a725-188f-43e7-88c3-be7d5d672520 None admin] PATH_INFO: `/v3/projects/0fa16d1165e84f94bf8fc56809c2564f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.858055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47a725-188f-43e7-88c3-be7d5d672520 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa16d1165e84f94bf8fc56809c2564f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:23.859528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47a725-188f-43e7-88c3-be7d5d672520 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:23.861225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 226/449] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:23 2022] GET /identity/v3/projects/0fa16d1165e84f94bf8fc56809c2564f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:23.866615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47a725-188f-43e7-88c3-be7d5d672520 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:23.902670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8fa1e-08eb-4c7b-b211-d08ab0cbb3f4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:23.916673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:23.931960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:23.942253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e5ab3-c127-4570-97e3-f10d8f7627fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:23.942912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e5ab3-c127-4570-97e3-f10d8f7627fd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:23.943241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e5ab3-c127-4570-97e3-f10d8f7627fd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:23.943529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e5ab3-c127-4570-97e3-f10d8f7627fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:23.971957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47a725-188f-43e7-88c3-be7d5d672520 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:24.007286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9855c8-8f03-41c5-a589-481715886ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:24.008147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9855c8-8f03-41c5-a589-481715886ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:24.009063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9855c8-8f03-41c5-a589-481715886ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:24.009350 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9855c8-8f03-41c5-a589-481715886ff4 None admin] PATH_INFO: `/v3/groups/a7a286534cbc463d86f040d67c900a28` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:24.010571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9855c8-8f03-41c5-a589-481715886ff4 None admin] RBAC: Authorizing `identity:get_group(group_id=a7a286534cbc463d86f040d67c900a28)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:24.012071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9855c8-8f03-41c5-a589-481715886ff4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:24.014151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 227/450] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:23 2022] GET /identity/v3/groups/a7a286534cbc463d86f040d67c900a28 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:24.014923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e5ab3-c127-4570-97e3-f10d8f7627fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:24.016427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e5ab3-c127-4570-97e3-f10d8f7627fd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:24.020459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9855c8-8f03-41c5-a589-481715886ff4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:24.119004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 224/451] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 15:44:24.122113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9855c8-8f03-41c5-a589-481715886ff4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:24.124620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e5ab3-c127-4570-97e3-f10d8f7627fd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:24.140410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:24.153560 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:24.158693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed49a26-a357-441c-bddd-4706afe2e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:24.159385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49a26-a357-441c-bddd-4706afe2e606 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:24.159677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49a26-a357-441c-bddd-4706afe2e606 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:24.159956 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed49a26-a357-441c-bddd-4706afe2e606 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:24.160790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed49a26-a357-441c-bddd-4706afe2e606 None admin] RBAC: Adding query filter params (group.id=a7a286534cbc463d86f040d67c900a28, role.id=8bd0b3ec424b423da0670486cc02bc49, scope.project.id=0fa16d1165e84f94bf8fc56809c2564f) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:24.161107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed49a26-a357-441c-bddd-4706afe2e606 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:24.162531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed49a26-a357-441c-bddd-4706afe2e606 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:24.169765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 228/452] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jun 21 15:44:24 2022] GET /identity/v3/role_assignments?group.id=a7a286534cbc463d86f040d67c900a28&scope.project.id=0fa16d1165e84f94bf8fc56809c2564f&role.id=8bd0b3ec424b423da0670486cc02bc49 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:24.232259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e5ab3-c127-4570-97e3-f10d8f7627fd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:24.269774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939374cb-5ea9-403b-b45b-b3b76ec731c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:24.270697 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939374cb-5ea9-403b-b45b-b3b76ec731c9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:24.270950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939374cb-5ea9-403b-b45b-b3b76ec731c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:24.271259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939374cb-5ea9-403b-b45b-b3b76ec731c9 None admin] PATH_INFO: `/v3/projects/f406bc3b64324ae8acf4eaa5547534ca` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:24.272518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939374cb-5ea9-403b-b45b-b3b76ec731c9 None admin] RBAC: Authorizing `identity:get_project(project_id=f406bc3b64324ae8acf4eaa5547534ca)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:24.274033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939374cb-5ea9-403b-b45b-b3b76ec731c9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:24.275839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 225/453] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:44:24 2022] GET /identity/v3/projects/f406bc3b64324ae8acf4eaa5547534ca => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:24.281861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed49a26-a357-441c-bddd-4706afe2e606 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:24.395608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed49a26-a357-441c-bddd-4706afe2e606 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:24.429697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69716f58-0279-452a-b03e-899e6d09a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:24.430606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716f58-0279-452a-b03e-899e6d09a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:24.430954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716f58-0279-452a-b03e-899e6d09a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:24.431341 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716f58-0279-452a-b03e-899e6d09a6e9 None admin] PATH_INFO: `/v3/groups/990a66f8a3bc4f0b8e7744e529538ac6` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:24.432533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69716f58-0279-452a-b03e-899e6d09a6e9 None admin] RBAC: Authorizing `identity:get_group(group_id=990a66f8a3bc4f0b8e7744e529538ac6)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:24.433979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69716f58-0279-452a-b03e-899e6d09a6e9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:24.435720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 229/454] 10.222.0.46 () {56 vars in 1180 bytes} [Tue Jun 21 15:44:24 2022] GET /identity/v3/groups/990a66f8a3bc4f0b8e7744e529538ac6 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:24.441731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939374cb-5ea9-403b-b45b-b3b76ec731c9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:24.534044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:24.556545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939374cb-5ea9-403b-b45b-b3b76ec731c9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:24.591437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d0dcd-0a92-48ad-bddb-0abcfbf8f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:24.592091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0dcd-0a92-48ad-bddb-0abcfbf8f44c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:24.592379 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0dcd-0a92-48ad-bddb-0abcfbf8f44c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:24.592659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0dcd-0a92-48ad-bddb-0abcfbf8f44c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:24.593496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d0dcd-0a92-48ad-bddb-0abcfbf8f44c None admin] RBAC: Adding query filter params (group.id=990a66f8a3bc4f0b8e7744e529538ac6, role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=f406bc3b64324ae8acf4eaa5547534ca) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:24.593816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d0dcd-0a92-48ad-bddb-0abcfbf8f44c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:24.595275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d0dcd-0a92-48ad-bddb-0abcfbf8f44c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:24.601903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 226/455] 10.222.0.46 () {56 vars in 1376 bytes} [Tue Jun 21 15:44:24 2022] GET /identity/v3/role_assignments?group.id=990a66f8a3bc4f0b8e7744e529538ac6&scope.project.id=f406bc3b64324ae8acf4eaa5547534ca&role.id=29dae918965d40bea71d83ffa2085316 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:27.419319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f533e8-6f68-445f-a216-e83f7ed1fc89 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:27.420348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f533e8-6f68-445f-a216-e83f7ed1fc89 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:27.420847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f533e8-6f68-445f-a216-e83f7ed1fc89 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:27.422696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 230/456] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:27.427948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80671b4f-b88f-4b26-8afc-79a97fc085fc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:27.428407 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80671b4f-b88f-4b26-8afc-79a97fc085fc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:27.428509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80671b4f-b88f-4b26-8afc-79a97fc085fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:27.448700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-80671b4f-b88f-4b26-8afc-79a97fc085fc None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:27.449915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-80671b4f-b88f-4b26-8afc-79a97fc085fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:27.527330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67fa48-7361-46d3-93be-3a55a73c8af0 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:27.527987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67fa48-7361-46d3-93be-3a55a73c8af0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:27.528483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67fa48-7361-46d3-93be-3a55a73c8af0 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:27.530370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 231/457] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:27.535969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c4e3a-67c0-4e59-a5fc-9eb7f70d4194 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:27.536258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c4e3a-67c0-4e59-a5fc-9eb7f70d4194 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:27.536741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c4e3a-67c0-4e59-a5fc-9eb7f70d4194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:27.552750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 227/458] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:27.568519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-011c4e3a-67c0-4e59-a5fc-9eb7f70d4194 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:27.570064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-011c4e3a-67c0-4e59-a5fc-9eb7f70d4194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:27.578353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80671b4f-b88f-4b26-8afc-79a97fc085fc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:27.675364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:27.690652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:27.707715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 232/459] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:27.709229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80671b4f-b88f-4b26-8afc-79a97fc085fc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:27.709447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509374ca-efde-4041-9a4f-e30241430cdd None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:27.709744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509374ca-efde-4041-9a4f-e30241430cdd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:27.710026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509374ca-efde-4041-9a4f-e30241430cdd None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:27.712131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 233/460] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:27.717592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa5d5-ff73-4960-aabe-0b9936786d49 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:27.717885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa5d5-ff73-4960-aabe-0b9936786d49 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:27.718169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa5d5-ff73-4960-aabe-0b9936786d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:27.737368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f47fa5d5-ff73-4960-aabe-0b9936786d49 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:27.738804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f47fa5d5-ff73-4960-aabe-0b9936786d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:27.748332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfad06-cbbd-46df-92a9-a2089974a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:27.749364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfad06-cbbd-46df-92a9-a2089974a86a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:27.749836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfad06-cbbd-46df-92a9-a2089974a86a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:27.750271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfad06-cbbd-46df-92a9-a2089974a86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:27.761544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfad06-cbbd-46df-92a9-a2089974a86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:27.763310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfad06-cbbd-46df-92a9-a2089974a86a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bfdfad06-cbbd-46df-92a9-a2089974a86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:27.783726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:27.784684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:27.785564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:27.785564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:27.785564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:27.785564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:27.792266 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 228/461] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:27.793368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfad06-cbbd-46df-92a9-a2089974a86a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:27.813692 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 234/462] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:27.814762 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fa5d5-ff73-4960-aabe-0b9936786d49 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:27.933466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfad06-cbbd-46df-92a9-a2089974a86a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:27.946246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fa5d5-ff73-4960-aabe-0b9936786d49 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:27.968501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:27.972996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:27.979147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a886c-a09f-4c62-a575-f4f151d8e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:27.980252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a886c-a09f-4c62-a575-f4f151d8e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:27.980544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a886c-a09f-4c62-a575-f4f151d8e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:27.980828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a886c-a09f-4c62-a575-f4f151d8e7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:27.985009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88db85-3042-4ae3-aa03-77999e36b4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:27.985879 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88db85-3042-4ae3-aa03-77999e36b4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:27.986321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88db85-3042-4ae3-aa03-77999e36b4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:27.986755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88db85-3042-4ae3-aa03-77999e36b4d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:27.987684 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88db85-3042-4ae3-aa03-77999e36b4d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:27.988154 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88db85-3042-4ae3-aa03-77999e36b4d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:27.989527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88db85-3042-4ae3-aa03-77999e36b4d8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:27.992625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a886c-a09f-4c62-a575-f4f151d8e7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:27.994653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a886c-a09f-4c62-a575-f4f151d8e7f6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:28.003336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 235/463] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:28.004850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1636e61-79fe-4abc-96bf-dd55123f2ad9 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.005150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1636e61-79fe-4abc-96bf-dd55123f2ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.005430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1636e61-79fe-4abc-96bf-dd55123f2ad9 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.006670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 236/464] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:28.007531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1636e61-79fe-4abc-96bf-dd55123f2ad9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-584a886c-a09f-4c62-a575-f4f151d8e7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:28.020400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:28.021382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:28.022200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:28.022200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:28.022200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:28.022200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:28.026647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 229/465] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:28.027291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a886c-a09f-4c62-a575-f4f151d8e7f6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:28.128173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1636e61-79fe-4abc-96bf-dd55123f2ad9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:28.141158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a886c-a09f-4c62-a575-f4f151d8e7f6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:28.165930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe75a0-307f-4cdb-b8b7-26851cc6c918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:28.166732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe75a0-307f-4cdb-b8b7-26851cc6c918 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.167019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe75a0-307f-4cdb-b8b7-26851cc6c918 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.167339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe75a0-307f-4cdb-b8b7-26851cc6c918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.176171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2e651-b4eb-4c1c-8626-3fb04396884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:28.176923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e651-b4eb-4c1c-8626-3fb04396884c None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.177219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e651-b4eb-4c1c-8626-3fb04396884c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.177505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e651-b4eb-4c1c-8626-3fb04396884c None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.178236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2e651-b4eb-4c1c-8626-3fb04396884c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:28.178689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe75a0-307f-4cdb-b8b7-26851cc6c918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:28.179707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2e651-b4eb-4c1c-8626-3fb04396884c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:28.180312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe75a0-307f-4cdb-b8b7-26851cc6c918 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:28.210490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 230/466] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:44:28 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:44:28.210490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31f54-707b-4b59-adf4-ba63a89d17f9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.210490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31f54-707b-4b59-adf4-ba63a89d17f9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-4dbe75a0-307f-4cdb-b8b7-26851cc6c918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:28.211009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:28.212331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:28.213329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:28.213329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:28.213329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:28.213329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:28.213541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31f54-707b-4b59-adf4-ba63a89d17f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.213634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 237/467] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:28.213634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe75a0-307f-4cdb-b8b7-26851cc6c918 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:28.245179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-33d31f54-707b-4b59-adf4-ba63a89d17f9 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:28.248572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-33d31f54-707b-4b59-adf4-ba63a89d17f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:28.264131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:28.308541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:28.357153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 231/468] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:28.358033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d31f54-707b-4b59-adf4-ba63a89d17f9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:28.358515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe75a0-307f-4cdb-b8b7-26851cc6c918 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:28.411954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05bf7-b8c5-4303-af28-c7987a57d08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:28.412855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05bf7-b8c5-4303-af28-c7987a57d08c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.412969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05bf7-b8c5-4303-af28-c7987a57d08c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.413202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05bf7-b8c5-4303-af28-c7987a57d08c None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.414455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05bf7-b8c5-4303-af28-c7987a57d08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:28.414773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05bf7-b8c5-4303-af28-c7987a57d08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:28.416702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05bf7-b8c5-4303-af28-c7987a57d08c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:28.431189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 238/469] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:28.433406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829e1a-a29e-4d82-840f-76d349f1d789 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.433947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829e1a-a29e-4d82-840f-76d349f1d789 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.433947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829e1a-a29e-4d82-840f-76d349f1d789 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.435435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 239/470] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:28.436138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77829e1a-a29e-4d82-840f-76d349f1d789 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:28.485004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d31f54-707b-4b59-adf4-ba63a89d17f9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:28.522538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba87471-127d-41bc-944b-49fe98a230f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:28.523302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba87471-127d-41bc-944b-49fe98a230f1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.523511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba87471-127d-41bc-944b-49fe98a230f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.524347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba87471-127d-41bc-944b-49fe98a230f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.525090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba87471-127d-41bc-944b-49fe98a230f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:28.525488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba87471-127d-41bc-944b-49fe98a230f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:28.526774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba87471-127d-41bc-944b-49fe98a230f1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:28.545281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 232/471] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:28.546483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1996027-f72b-455b-a1e0-796ce5a3f44e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.546852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1996027-f72b-455b-a1e0-796ce5a3f44e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.547133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1996027-f72b-455b-a1e0-796ce5a3f44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.555480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:28.562888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77829e1a-a29e-4d82-840f-76d349f1d789 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:28.565120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e1996027-f72b-455b-a1e0-796ce5a3f44e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:28.566309 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e1996027-f72b-455b-a1e0-796ce5a3f44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:28.591634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:28.608262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d2e4-7c60-42a4-9fed-2e3ce4a9f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:28.609068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d2e4-7c60-42a4-9fed-2e3ce4a9f234 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.609357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d2e4-7c60-42a4-9fed-2e3ce4a9f234 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.609635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8d2e4-7c60-42a4-9fed-2e3ce4a9f234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.622001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8d2e4-7c60-42a4-9fed-2e3ce4a9f234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:28.623686 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8d2e4-7c60-42a4-9fed-2e3ce4a9f234 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a1f8d2e4-7c60-42a4-9fed-2e3ce4a9f234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:28.644927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:28.646024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:28.646915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:28.646915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:28.646915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:28.646915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:28.646915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 240/472] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:28.647384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d2e4-7c60-42a4-9fed-2e3ce4a9f234 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:28.667833 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 233/473] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:28.668927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1996027-f72b-455b-a1e0-796ce5a3f44e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:28.767222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8d2e4-7c60-42a4-9fed-2e3ce4a9f234 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:28.783512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1996027-f72b-455b-a1e0-796ce5a3f44e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:28.804190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c710b-5230-4d14-9879-b052ce144a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:28.804865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c710b-5230-4d14-9879-b052ce144a51 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.805946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c710b-5230-4d14-9879-b052ce144a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.806194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c710b-5230-4d14-9879-b052ce144a51 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.806902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c710b-5230-4d14-9879-b052ce144a51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:28.808399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c710b-5230-4d14-9879-b052ce144a51 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:28.822312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a8e98-4664-4714-8dfa-aed5a4e94c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:28.823367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8e98-4664-4714-8dfa-aed5a4e94c96 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:28.823919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8e98-4664-4714-8dfa-aed5a4e94c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:28.824393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a8e98-4664-4714-8dfa-aed5a4e94c96 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:28.825104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a8e98-4664-4714-8dfa-aed5a4e94c96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:28.826560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a8e98-4664-4714-8dfa-aed5a4e94c96 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:28.839205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 241/474] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:44:28 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:44:28.839205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c710b-5230-4d14-9879-b052ce144a51 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:28.844121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:28.858370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 234/475] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:44:28 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:44:28.859783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a8e98-4664-4714-8dfa-aed5a4e94c96 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:28.877791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:29.055470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a8e98-4664-4714-8dfa-aed5a4e94c96 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:29.081362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c710b-5230-4d14-9879-b052ce144a51 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:29.099801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775afc79-a700-4970-96d9-92ba0df70be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:29.100529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775afc79-a700-4970-96d9-92ba0df70be6 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:29.100774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775afc79-a700-4970-96d9-92ba0df70be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:29.101052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775afc79-a700-4970-96d9-92ba0df70be6 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:29.101992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775afc79-a700-4970-96d9-92ba0df70be6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:29.103955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775afc79-a700-4970-96d9-92ba0df70be6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:29.111949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.sql.core [None req-775afc79-a700-4970-96d9-92ba0df70be6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 15:44:29.111949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 15:44:29.111949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [parameters: {'id': 'c038733b8e1149f9938d136643f4d1fe', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 15:44:29.111949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80234) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 15:44:29.124562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efac9b5-bfab-41c3-877a-abde39e59530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:29.125238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efac9b5-bfab-41c3-877a-abde39e59530 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:29.125534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efac9b5-bfab-41c3-877a-abde39e59530 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:29.125842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efac9b5-bfab-41c3-877a-abde39e59530 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:29.126563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efac9b5-bfab-41c3-877a-abde39e59530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:29.126877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efac9b5-bfab-41c3-877a-abde39e59530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:29.128316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efac9b5-bfab-41c3-877a-abde39e59530 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-775afc79-a700-4970-96d9-92ba0df70be6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result.read() Jun 21 15:44:29.129522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return ref.to_dict() Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:44:29.130669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application yield resource Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise self.value Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application session.commit() Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 15:44:29.131652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.session.flush() Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application compat.raise_( Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 15:44:29.133140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:44:29.134302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result.read() Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:44:29.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [parameters: {'id': 'c038733b8e1149f9938d136643f4d1fe', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:29.138001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 15:44:29.140301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:29.142545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 235/476] 10.222.0.46 () {60 vars in 1131 bytes} [Tue Jun 21 15:44:28 2022] POST /identity/v3/roles => generated 144 bytes in 272 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:29.142545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775afc79-a700-4970-96d9-92ba0df70be6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:29.150142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 242/477] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:29.155416 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efac9b5-bfab-41c3-877a-abde39e59530 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:29.246295 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:29.247841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:29.279440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775afc79-a700-4970-96d9-92ba0df70be6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:29.309904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efac9b5-bfab-41c3-877a-abde39e59530 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:29.323532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76794080-bf7e-4675-98a3-6ab9416914b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:29.324859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76794080-bf7e-4675-98a3-6ab9416914b4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:29.324859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76794080-bf7e-4675-98a3-6ab9416914b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:29.325168 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76794080-bf7e-4675-98a3-6ab9416914b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:29.338428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76794080-bf7e-4675-98a3-6ab9416914b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-76794080-bf7e-4675-98a3-6ab9416914b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:29.347399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:29.348580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:44:29.349591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:29.355443 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 236/478] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:44:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:29.363185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76794080-bf7e-4675-98a3-6ab9416914b4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:29.363345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c1aef-548c-4a22-9db5-77ecd2d6beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:29.366296 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c1aef-548c-4a22-9db5-77ecd2d6beea None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:29.366610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c1aef-548c-4a22-9db5-77ecd2d6beea None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:29.366903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c1aef-548c-4a22-9db5-77ecd2d6beea None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:29.368211 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c1aef-548c-4a22-9db5-77ecd2d6beea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:29.370023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c1aef-548c-4a22-9db5-77ecd2d6beea None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:29.430669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 243/479] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:44:29 2022] POST /identity/v3/users => generated 249 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:44:29.493677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76794080-bf7e-4675-98a3-6ab9416914b4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:29.535490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a1e8b-31fd-4c8c-85c0-eb0dd255c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:29.536244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a1e8b-31fd-4c8c-85c0-eb0dd255c03a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:29.536595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a1e8b-31fd-4c8c-85c0-eb0dd255c03a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:29.536888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a1e8b-31fd-4c8c-85c0-eb0dd255c03a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:29.537679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a1e8b-31fd-4c8c-85c0-eb0dd255c03a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:29.537998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a1e8b-31fd-4c8c-85c0-eb0dd255c03a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:29.540090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a1e8b-31fd-4c8c-85c0-eb0dd255c03a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:29.543223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:29.556690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 237/480] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:30.738412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95186e66-0511-49d0-acfc-8d0d839b95aa None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:30.738961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95186e66-0511-49d0-acfc-8d0d839b95aa None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:30.738961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95186e66-0511-49d0-acfc-8d0d839b95aa None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:30.740639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 244/481] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:30.746450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c613a0-6ccb-4ca5-bec4-649e8bd2e3bf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:30.746895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c613a0-6ccb-4ca5-bec4-649e8bd2e3bf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:30.747076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c613a0-6ccb-4ca5-bec4-649e8bd2e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:30.765402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-14c613a0-6ccb-4ca5-bec4-649e8bd2e3bf None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:30.766619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-14c613a0-6ccb-4ca5-bec4-649e8bd2e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:30.838747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 238/482] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:30.863381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95186e66-0511-49d0-acfc-8d0d839b95aa None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:31.033230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95186e66-0511-49d0-acfc-8d0d839b95aa None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:31.063503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:31.081706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb730a81-45b0-418d-8055-72c46cc47e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:31.082854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730a81-45b0-418d-8055-72c46cc47e57 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:31.085235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730a81-45b0-418d-8055-72c46cc47e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:31.085752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730a81-45b0-418d-8055-72c46cc47e57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:31.104508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb730a81-45b0-418d-8055-72c46cc47e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-eb730a81-45b0-418d-8055-72c46cc47e57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:31.112811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:31.113760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:31.114541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:31.121402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 245/483] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:31.128240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c613a0-6ccb-4ca5-bec4-649e8bd2e3bf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:31.245424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c613a0-6ccb-4ca5-bec4-649e8bd2e3bf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:31.276171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:31.284834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89bd68-797f-4af4-83e4-b601cb582c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:31.285439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89bd68-797f-4af4-83e4-b601cb582c22 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:31.285731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89bd68-797f-4af4-83e4-b601cb582c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:31.286016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89bd68-797f-4af4-83e4-b601cb582c22 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:31.286786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89bd68-797f-4af4-83e4-b601cb582c22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:31.287100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89bd68-797f-4af4-83e4-b601cb582c22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:31.288536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89bd68-797f-4af4-83e4-b601cb582c22 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:31.298117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 239/484] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:31.303873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb730a81-45b0-418d-8055-72c46cc47e57 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:31.459094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb730a81-45b0-418d-8055-72c46cc47e57 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:31.503980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb8025-ceb2-40b8-b58b-3339291b547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:31.504794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb8025-ceb2-40b8-b58b-3339291b547f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:31.505088 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb8025-ceb2-40b8-b58b-3339291b547f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:31.505372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb8025-ceb2-40b8-b58b-3339291b547f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:31.525329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb8025-ceb2-40b8-b58b-3339291b547f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:31.526890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb8025-ceb2-40b8-b58b-3339291b547f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-babb8025-ceb2-40b8-b58b-3339291b547f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:31.550683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:31.551621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:31.552470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:31.552470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:31.552470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:31.552470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:31.552470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 246/485] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:31.558368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89bd68-797f-4af4-83e4-b601cb582c22 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:31.662684 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491db42-6800-437e-8b1d-574cfb8c722d None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:31.663025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491db42-6800-437e-8b1d-574cfb8c722d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:31.663459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491db42-6800-437e-8b1d-574cfb8c722d None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:31.665806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 247/486] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:31.676549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152358db-8ad3-4ec0-b29c-75a2d751cf40 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:31.676922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152358db-8ad3-4ec0-b29c-75a2d751cf40 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:31.677417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152358db-8ad3-4ec0-b29c-75a2d751cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:31.700872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-152358db-8ad3-4ec0-b29c-75a2d751cf40 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:31.702655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-152358db-8ad3-4ec0-b29c-75a2d751cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:31.715963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89bd68-797f-4af4-83e4-b601cb582c22 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:31.750460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:31.759956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131fddd-bd45-495f-a02f-3f9dbf978266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:31.760784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131fddd-bd45-495f-a02f-3f9dbf978266 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:31.761142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131fddd-bd45-495f-a02f-3f9dbf978266 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:31.761498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131fddd-bd45-495f-a02f-3f9dbf978266 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:31.762413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131fddd-bd45-495f-a02f-3f9dbf978266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:31.762891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131fddd-bd45-495f-a02f-3f9dbf978266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:31.764743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131fddd-bd45-495f-a02f-3f9dbf978266 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:31.778897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 240/487] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:31.780419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371af50-a19d-471c-a9b7-9752328bf1c2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:31.780782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371af50-a19d-471c-a9b7-9752328bf1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:31.781132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371af50-a19d-471c-a9b7-9752328bf1c2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:31.782556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 241/488] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:31.784207 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371af50-a19d-471c-a9b7-9752328bf1c2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:31.810673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 248/489] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:31.812272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5cf5b-b7a5-4a9e-a564-4e41d44931e9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:31.812570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5cf5b-b7a5-4a9e-a564-4e41d44931e9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:31.812857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5cf5b-b7a5-4a9e-a564-4e41d44931e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:31.834907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ebd5cf5b-b7a5-4a9e-a564-4e41d44931e9 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:31.836973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ebd5cf5b-b7a5-4a9e-a564-4e41d44931e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:31.843408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:31.904714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371af50-a19d-471c-a9b7-9752328bf1c2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:31.932649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 249/490] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:31.933569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5cf5b-b7a5-4a9e-a564-4e41d44931e9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:31.965445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a8fe1-57ff-42e3-82be-9ad5ba781420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:31.966666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a8fe1-57ff-42e3-82be-9ad5ba781420 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:31.967261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a8fe1-57ff-42e3-82be-9ad5ba781420 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:31.967732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a8fe1-57ff-42e3-82be-9ad5ba781420 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:31.976282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a8fe1-57ff-42e3-82be-9ad5ba781420 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:31.978059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a8fe1-57ff-42e3-82be-9ad5ba781420 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-099a8fe1-57ff-42e3-82be-9ad5ba781420 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:31.995575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:31.996514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:31.997389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:31.997389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:31.997389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:31.997389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:31.997389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:31.997389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:31.997389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:31.997389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:31.997389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:44:31.997389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:32.000086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 242/491] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jun 21 15:44:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:32.001102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a8fe1-57ff-42e3-82be-9ad5ba781420 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:32.058514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:32.071267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5cf5b-b7a5-4a9e-a564-4e41d44931e9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:32.117669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a8fe1-57ff-42e3-82be-9ad5ba781420 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:32.118485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652154-d6eb-4569-a777-0a97b1a4e3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:32.119327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652154-d6eb-4569-a777-0a97b1a4e3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.119636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652154-d6eb-4569-a777-0a97b1a4e3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.119907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652154-d6eb-4569-a777-0a97b1a4e3c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.131401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:32.135392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62652154-d6eb-4569-a777-0a97b1a4e3c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-62652154-d6eb-4569-a777-0a97b1a4e3c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:32.146832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:32.147834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 250/492] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:32.150031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652154-d6eb-4569-a777-0a97b1a4e3c9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:32.165220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c2ab9-3a24-49c7-a63b-fe10428e43c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:32.166455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c2ab9-3a24-49c7-a63b-fe10428e43c8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.167026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c2ab9-3a24-49c7-a63b-fe10428e43c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.167551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c2ab9-3a24-49c7-a63b-fe10428e43c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.179828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c2ab9-3a24-49c7-a63b-fe10428e43c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-be1c2ab9-3a24-49c7-a63b-fe10428e43c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:32.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:32.190470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:32.191707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:32.194256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 243/493] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:32.195385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c2ab9-3a24-49c7-a63b-fe10428e43c8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:32.272988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652154-d6eb-4569-a777-0a97b1a4e3c9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:32.306161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c2ab9-3a24-49c7-a63b-fe10428e43c8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:32.308347 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7928b3-d27d-4ccd-83df-9b2ac48ff65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:32.309021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7928b3-d27d-4ccd-83df-9b2ac48ff65f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.309305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7928b3-d27d-4ccd-83df-9b2ac48ff65f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.309580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7928b3-d27d-4ccd-83df-9b2ac48ff65f None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.310420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7928b3-d27d-4ccd-83df-9b2ac48ff65f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:32.310732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7928b3-d27d-4ccd-83df-9b2ac48ff65f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:32.312201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7928b3-d27d-4ccd-83df-9b2ac48ff65f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:32.340548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b833-4f2c-46c0-a7ef-47ac24e4f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:32.341140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b833-4f2c-46c0-a7ef-47ac24e4f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.341429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b833-4f2c-46c0-a7ef-47ac24e4f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.341713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b833-4f2c-46c0-a7ef-47ac24e4f2e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.342466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26b833-4f2c-46c0-a7ef-47ac24e4f2e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:32.342778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26b833-4f2c-46c0-a7ef-47ac24e4f2e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:32.344214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26b833-4f2c-46c0-a7ef-47ac24e4f2e2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:32.350874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 251/494] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jun 21 15:44:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:32.352021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7928b3-d27d-4ccd-83df-9b2ac48ff65f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:32.352437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 244/495] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:32.353887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd38d-6a8f-40b4-8576-4e5d1d99b1aa None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.353994 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd38d-6a8f-40b4-8576-4e5d1d99b1aa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.354262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd38d-6a8f-40b4-8576-4e5d1d99b1aa None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.356364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 245/496] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:32.357626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09ab55-c02a-406e-8e9a-a6a06e65c370 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.357924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09ab55-c02a-406e-8e9a-a6a06e65c370 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.358207 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09ab55-c02a-406e-8e9a-a6a06e65c370 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.359764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 246/497] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:32.360410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09ab55-c02a-406e-8e9a-a6a06e65c370 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:32.369470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:32.397883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:32.464132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7928b3-d27d-4ccd-83df-9b2ac48ff65f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:32.471060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09ab55-c02a-406e-8e9a-a6a06e65c370 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:32.501434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b1f28-b43a-4a00-b50b-4965b74dd0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:32.502105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b1f28-b43a-4a00-b50b-4965b74dd0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.502401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b1f28-b43a-4a00-b50b-4965b74dd0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.502680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b1f28-b43a-4a00-b50b-4965b74dd0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.503864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b1f28-b43a-4a00-b50b-4965b74dd0d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:32.503864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b1f28-b43a-4a00-b50b-4965b74dd0d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:32.505145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b1f28-b43a-4a00-b50b-4965b74dd0d2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:32.505571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91427e97-2553-4174-871b-844acead668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:32.506220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91427e97-2553-4174-871b-844acead668c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.506513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91427e97-2553-4174-871b-844acead668c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.506790 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91427e97-2553-4174-871b-844acead668c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.513770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 252/498] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:32.514802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf6a6-3929-42d5-b0cf-d5cbf673c148 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.515097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf6a6-3929-42d5-b0cf-d5cbf673c148 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.515412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf6a6-3929-42d5-b0cf-d5cbf673c148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.531511 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5a9bf6a6-3929-42d5-b0cf-d5cbf673c148 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:32.532758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5a9bf6a6-3929-42d5-b0cf-d5cbf673c148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:32.583571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91427e97-2553-4174-871b-844acead668c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:32.585058 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91427e97-2553-4174-871b-844acead668c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:32.606082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 253/499] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:32.606670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf6a6-3929-42d5-b0cf-d5cbf673c148 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:32.609155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:32.620685 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:32.700128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 247/500] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:32.701489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3faaaa-b238-45b5-87b0-64bc38be8249 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.701786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3faaaa-b238-45b5-87b0-64bc38be8249 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.702062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3faaaa-b238-45b5-87b0-64bc38be8249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.718556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8e3faaaa-b238-45b5-87b0-64bc38be8249 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:32.719823 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8e3faaaa-b238-45b5-87b0-64bc38be8249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:32.721896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf6a6-3929-42d5-b0cf-d5cbf673c148 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:32.756376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440592e5-7c58-4212-a2cd-37d17cd94993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:32.757181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440592e5-7c58-4212-a2cd-37d17cd94993 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.757470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440592e5-7c58-4212-a2cd-37d17cd94993 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.757750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440592e5-7c58-4212-a2cd-37d17cd94993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.768179 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440592e5-7c58-4212-a2cd-37d17cd94993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:32.769640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440592e5-7c58-4212-a2cd-37d17cd94993 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-440592e5-7c58-4212-a2cd-37d17cd94993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:32.788715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:32.789767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:32.790667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:32.790667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:32.790667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:32.790667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:32.790872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 248/501] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:32.791298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 254/502] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:32.791298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440592e5-7c58-4212-a2cd-37d17cd94993 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:32.792713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3faaaa-b238-45b5-87b0-64bc38be8249 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:32.858374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:32.866041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:32.906323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3faaaa-b238-45b5-87b0-64bc38be8249 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:32.906557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440592e5-7c58-4212-a2cd-37d17cd94993 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:32.941153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb55c2b-bec8-4086-9afa-e104bb33b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:32.941950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb55c2b-bec8-4086-9afa-e104bb33b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.942236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb55c2b-bec8-4086-9afa-e104bb33b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.942514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb55c2b-bec8-4086-9afa-e104bb33b5d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.943330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacd0fb-d06d-4d74-8ba8-3764c1e40e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:32.944118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd0fb-d06d-4d74-8ba8-3764c1e40e1d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:32.944404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd0fb-d06d-4d74-8ba8-3764c1e40e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:32.944675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd0fb-d06d-4d74-8ba8-3764c1e40e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:32.954421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb55c2b-bec8-4086-9afa-e104bb33b5d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:32.955780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacd0fb-d06d-4d74-8ba8-3764c1e40e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:32.955940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb55c2b-bec8-4086-9afa-e104bb33b5d2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:32.957226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacd0fb-d06d-4d74-8ba8-3764c1e40e1d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-ceb55c2b-bec8-4086-9afa-e104bb33b5d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:32.973925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:32.974817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:32.975791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:32.975791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:32.975791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:32.975791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6cacd0fb-d06d-4d74-8ba8-3764c1e40e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:32.976002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:32.977312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:32.978156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:32.978156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:32.978156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:32.978156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:32.978156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 249/503] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:32.978156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacd0fb-d06d-4d74-8ba8-3764c1e40e1d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:32.979498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 255/504] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:32.980753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb55c2b-bec8-4086-9afa-e104bb33b5d2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.078454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacd0fb-d06d-4d74-8ba8-3764c1e40e1d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.083633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb55c2b-bec8-4086-9afa-e104bb33b5d2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.090833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:33.093322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:33.115615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c4819-b644-4c16-a47d-2daf0790c21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.116335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c4819-b644-4c16-a47d-2daf0790c21f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.116614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c4819-b644-4c16-a47d-2daf0790c21f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.116913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c4819-b644-4c16-a47d-2daf0790c21f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.120297 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5718a-01b8-42c0-9d11-80148ede243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.120966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5718a-01b8-42c0-9d11-80148ede243a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.121256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5718a-01b8-42c0-9d11-80148ede243a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.121539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5718a-01b8-42c0-9d11-80148ede243a None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.122268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5718a-01b8-42c0-9d11-80148ede243a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:33.122584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5718a-01b8-42c0-9d11-80148ede243a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:33.124018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5718a-01b8-42c0-9d11-80148ede243a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:33.128279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c4819-b644-4c16-a47d-2daf0790c21f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:33.129713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c4819-b644-4c16-a47d-2daf0790c21f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:33.137086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 256/505] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:33.137910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5718a-01b8-42c0-9d11-80148ede243a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-223c4819-b644-4c16-a47d-2daf0790c21f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:33.148923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:33.149834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:33.150894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:33.150894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:33.150894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:33.150894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:33.150894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 250/506] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:33.151261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c4819-b644-4c16-a47d-2daf0790c21f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.245076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5718a-01b8-42c0-9d11-80148ede243a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.253813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c4819-b644-4c16-a47d-2daf0790c21f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.283241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6bcba-b69d-4d36-9866-fe02935f720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.284043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6bcba-b69d-4d36-9866-fe02935f720b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.284331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6bcba-b69d-4d36-9866-fe02935f720b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.284605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6bcba-b69d-4d36-9866-fe02935f720b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.291452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba92a-2d27-48ad-99f1-602ebe9f94c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.292109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba92a-2d27-48ad-99f1-602ebe9f94c2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.292396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba92a-2d27-48ad-99f1-602ebe9f94c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.292673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba92a-2d27-48ad-99f1-602ebe9f94c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.293395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ba92a-2d27-48ad-99f1-602ebe9f94c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:33.293702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ba92a-2d27-48ad-99f1-602ebe9f94c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:33.295102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ba92a-2d27-48ad-99f1-602ebe9f94c2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:33.295966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6bcba-b69d-4d36-9866-fe02935f720b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a1d6bcba-b69d-4d36-9866-fe02935f720b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:33.303878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:33.304758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:33.306405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 257/507] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:33.307056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 251/508] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:33.307629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6bcba-b69d-4d36-9866-fe02935f720b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.307825 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba92a-2d27-48ad-99f1-602ebe9f94c2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.337517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:33.344123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:33.413829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba92a-2d27-48ad-99f1-602ebe9f94c2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.421542 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6bcba-b69d-4d36-9866-fe02935f720b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.449695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e29747-2879-4484-883c-07858232edc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.450744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e29747-2879-4484-883c-07858232edc1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.451056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e29747-2879-4484-883c-07858232edc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.451392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e29747-2879-4484-883c-07858232edc1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.455326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecedcbb-dc89-4e5a-b2f5-f5c1e9a66a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.455990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecedcbb-dc89-4e5a-b2f5-f5c1e9a66a26 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.456283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecedcbb-dc89-4e5a-b2f5-f5c1e9a66a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.456570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecedcbb-dc89-4e5a-b2f5-f5c1e9a66a26 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.457303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecedcbb-dc89-4e5a-b2f5-f5c1e9a66a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:33.457619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecedcbb-dc89-4e5a-b2f5-f5c1e9a66a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:33.459023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecedcbb-dc89-4e5a-b2f5-f5c1e9a66a26 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:33.459338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e29747-2879-4484-883c-07858232edc1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:33.460789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e29747-2879-4484-883c-07858232edc1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:33.471444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 258/509] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:33.472257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecedcbb-dc89-4e5a-b2f5-f5c1e9a66a26 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-32e29747-2879-4484-883c-07858232edc1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:33.475824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:33.477442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:33.478556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 252/510] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:33.479304 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e29747-2879-4484-883c-07858232edc1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.566722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:33.574102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:33.584783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecedcbb-dc89-4e5a-b2f5-f5c1e9a66a26 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.591185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e29747-2879-4484-883c-07858232edc1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.620683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae8530-8aa8-4c65-bf1a-922d2c69d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.621356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae8530-8aa8-4c65-bf1a-922d2c69d16b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.621636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae8530-8aa8-4c65-bf1a-922d2c69d16b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.621913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae8530-8aa8-4c65-bf1a-922d2c69d16b None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.622636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae8530-8aa8-4c65-bf1a-922d2c69d16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:33.622941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae8530-8aa8-4c65-bf1a-922d2c69d16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:33.624344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae8530-8aa8-4c65-bf1a-922d2c69d16b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:33.628632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2006fe-5489-4ed8-9963-2a23ebd4ec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.629429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2006fe-5489-4ed8-9963-2a23ebd4ec57 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.629718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2006fe-5489-4ed8-9963-2a23ebd4ec57 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.630013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2006fe-5489-4ed8-9963-2a23ebd4ec57 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.635783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 259/511] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:33.636792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae8530-8aa8-4c65-bf1a-922d2c69d16b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.638888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2006fe-5489-4ed8-9963-2a23ebd4ec57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:33.640390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2006fe-5489-4ed8-9963-2a23ebd4ec57 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-db2006fe-5489-4ed8-9963-2a23ebd4ec57 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:33.656219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:33.657297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 253/512] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:33.658190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2006fe-5489-4ed8-9963-2a23ebd4ec57 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.744579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae8530-8aa8-4c65-bf1a-922d2c69d16b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.764715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2006fe-5489-4ed8-9963-2a23ebd4ec57 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.786661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a3660-b1b2-49ef-a240-2a6619357c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.787362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a3660-b1b2-49ef-a240-2a6619357c95 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.787655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a3660-b1b2-49ef-a240-2a6619357c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.788067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a3660-b1b2-49ef-a240-2a6619357c95 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.789878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a3660-b1b2-49ef-a240-2a6619357c95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:33.790340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a3660-b1b2-49ef-a240-2a6619357c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:33.792562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a3660-b1b2-49ef-a240-2a6619357c95 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:33.806015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ddf5f-ce23-4ed3-8132-bbd327cd061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.811098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ddf5f-ce23-4ed3-8132-bbd327cd061f None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.811375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 260/513] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:33.811476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ddf5f-ce23-4ed3-8132-bbd327cd061f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.811476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ddf5f-ce23-4ed3-8132-bbd327cd061f None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.811642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a3660-b1b2-49ef-a240-2a6619357c95 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.811719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ddf5f-ce23-4ed3-8132-bbd327cd061f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:33.811719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ddf5f-ce23-4ed3-8132-bbd327cd061f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:33.819825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:33.829742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 254/514] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:44:33 2022] POST /identity/v3/users => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:44:33.830569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ddf5f-ce23-4ed3-8132-bbd327cd061f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:33.833267 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:33.944173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a3660-b1b2-49ef-a240-2a6619357c95 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.963245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ddf5f-ce23-4ed3-8132-bbd327cd061f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:33.986751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a5cf-bc19-4564-9290-ab4c36de8c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:33.987598 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a5cf-bc19-4564-9290-ab4c36de8c5b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:33.987889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a5cf-bc19-4564-9290-ab4c36de8c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:33.988678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a5cf-bc19-4564-9290-ab4c36de8c5b None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:33.989048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13a5cf-bc19-4564-9290-ab4c36de8c5b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:33.989328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13a5cf-bc19-4564-9290-ab4c36de8c5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:33.991450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13a5cf-bc19-4564-9290-ab4c36de8c5b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:34.001228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e684814-8685-4b5f-9fd0-5172bfa22fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:34.002089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684814-8685-4b5f-9fd0-5172bfa22fcd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:34.002503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684814-8685-4b5f-9fd0-5172bfa22fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:34.002787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684814-8685-4b5f-9fd0-5172bfa22fcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:34.010811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e684814-8685-4b5f-9fd0-5172bfa22fcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:34.012422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e684814-8685-4b5f-9fd0-5172bfa22fcd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:34.012527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 261/515] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jun 21 15:44:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:34.017286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a5cf-bc19-4564-9290-ab4c36de8c5b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6e684814-8685-4b5f-9fd0-5172bfa22fcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:34.029600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:34.030474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:34.031344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:34.031344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:34.031344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:34.031344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:34.031344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:34.031344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:34.031344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:34.031344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:34.031344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 255/516] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:34.033774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e684814-8685-4b5f-9fd0-5172bfa22fcd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:34.091882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:34.103924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:34.130969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a5cf-bc19-4564-9290-ab4c36de8c5b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:34.160433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e684814-8685-4b5f-9fd0-5172bfa22fcd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:34.187657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e73d39-45d7-4556-b3f5-c4ef8a46d804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:34.188336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73d39-45d7-4556-b3f5-c4ef8a46d804 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:34.188627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73d39-45d7-4556-b3f5-c4ef8a46d804 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:34.188910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73d39-45d7-4556-b3f5-c4ef8a46d804 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:34.189772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e73d39-45d7-4556-b3f5-c4ef8a46d804 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:34.190094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e73d39-45d7-4556-b3f5-c4ef8a46d804 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:34.191591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e73d39-45d7-4556-b3f5-c4ef8a46d804 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:34.207872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a39df-e8ab-4763-85a6-d49575a78366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:34.208744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a39df-e8ab-4763-85a6-d49575a78366 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:34.209045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a39df-e8ab-4763-85a6-d49575a78366 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:34.209343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a39df-e8ab-4763-85a6-d49575a78366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:34.217481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 262/517] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jun 21 15:44:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:34.218708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e73d39-45d7-4556-b3f5-c4ef8a46d804 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:34.222383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a39df-e8ab-4763-85a6-d49575a78366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:34.224077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a39df-e8ab-4763-85a6-d49575a78366 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3d7a39df-e8ab-4763-85a6-d49575a78366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:34.245688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:34.246742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:34.247778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:34.247778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:34.247778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:34.247778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:34.251853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 256/518] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:34.252553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a39df-e8ab-4763-85a6-d49575a78366 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:34.339702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e73d39-45d7-4556-b3f5-c4ef8a46d804 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:34.366255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:34.380335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a39df-e8ab-4763-85a6-d49575a78366 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:34.381602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30881b-6e22-4e42-9443-f7be9a2639f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:34.382583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30881b-6e22-4e42-9443-f7be9a2639f8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:34.384231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30881b-6e22-4e42-9443-f7be9a2639f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:34.384231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30881b-6e22-4e42-9443-f7be9a2639f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:34.400594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:34.424476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ceece4-e439-4e51-82ee-ead24a8f7fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:34.425143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceece4-e439-4e51-82ee-ead24a8f7fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:34.425684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceece4-e439-4e51-82ee-ead24a8f7fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:34.425684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceece4-e439-4e51-82ee-ead24a8f7fa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:34.426955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ceece4-e439-4e51-82ee-ead24a8f7fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:34.426955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ceece4-e439-4e51-82ee-ead24a8f7fa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:34.428225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ceece4-e439-4e51-82ee-ead24a8f7fa1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:34.451774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 257/519] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:34.451774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ceece4-e439-4e51-82ee-ead24a8f7fa1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:34.473676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30881b-6e22-4e42-9443-f7be9a2639f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:34.475504 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30881b-6e22-4e42-9443-f7be9a2639f8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:34.569327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ceece4-e439-4e51-82ee-ead24a8f7fa1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:34.598282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 263/520] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:34.599155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30881b-6e22-4e42-9443-f7be9a2639f8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:34.615061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5b4c1-e851-4f5f-a2fb-296f01db0215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:34.615854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5b4c1-e851-4f5f-a2fb-296f01db0215 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:34.616038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5b4c1-e851-4f5f-a2fb-296f01db0215 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:34.616319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5b4c1-e851-4f5f-a2fb-296f01db0215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:34.627360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:34.672197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:34.702404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5b4c1-e851-4f5f-a2fb-296f01db0215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:34.703947 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5b4c1-e851-4f5f-a2fb-296f01db0215 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:34.722551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30881b-6e22-4e42-9443-f7be9a2639f8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:34.759474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b2c9f-c871-4215-8be0-5e97c86e0be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:34.760142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b2c9f-c871-4215-8be0-5e97c86e0be3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:34.760438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b2c9f-c871-4215-8be0-5e97c86e0be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:34.760706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b2c9f-c871-4215-8be0-5e97c86e0be3 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:34.761518 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b2c9f-c871-4215-8be0-5e97c86e0be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:34.761911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b2c9f-c871-4215-8be0-5e97c86e0be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:34.763228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b2c9f-c871-4215-8be0-5e97c86e0be3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:34.779774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 264/521] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:34.779774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b2c9f-c871-4215-8be0-5e97c86e0be3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:34.821786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 258/522] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:34.822567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5b4c1-e851-4f5f-a2fb-296f01db0215 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:34.875926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:34.895643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b2c9f-c871-4215-8be0-5e97c86e0be3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:34.902353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:34.931138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5b4c1-e851-4f5f-a2fb-296f01db0215 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:34.934538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea52d-e13b-4ef7-8939-d3445c95d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:34.935232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea52d-e13b-4ef7-8939-d3445c95d0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:34.935526 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea52d-e13b-4ef7-8939-d3445c95d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:34.935807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dea52d-e13b-4ef7-8939-d3445c95d0f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:34.936653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea52d-e13b-4ef7-8939-d3445c95d0f3 None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2ab989a935eb4d91a94611cededd3cf6) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:34.936971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea52d-e13b-4ef7-8939-d3445c95d0f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:34.938436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dea52d-e13b-4ef7-8939-d3445c95d0f3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:34.955215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 265/523] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:34 2022] GET /identity/v3/role_assignments?user.id=2ab989a935eb4d91a94611cededd3cf6&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:34.955215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea52d-e13b-4ef7-8939-d3445c95d0f3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:34.988260 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88d3c9-6ee8-4fb4-8a00-f4662d1c5437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:34.989755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88d3c9-6ee8-4fb4-8a00-f4662d1c5437 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:34.990237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88d3c9-6ee8-4fb4-8a00-f4662d1c5437 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:34.990530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88d3c9-6ee8-4fb4-8a00-f4662d1c5437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:35.008749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88d3c9-6ee8-4fb4-8a00-f4662d1c5437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:35.011413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88d3c9-6ee8-4fb4-8a00-f4662d1c5437 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fb88d3c9-6ee8-4fb4-8a00-f4662d1c5437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:35.041494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:35.042757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:35.043651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:35.043651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:35.043651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:35.043651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:35.043651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 259/524] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:35.043651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88d3c9-6ee8-4fb4-8a00-f4662d1c5437 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:35.094996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dea52d-e13b-4ef7-8939-d3445c95d0f3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:35.156100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f66da-2e38-4020-814e-353293725d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:35.157378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f66da-2e38-4020-814e-353293725d6d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:35.157672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f66da-2e38-4020-814e-353293725d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:35.158377 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f66da-2e38-4020-814e-353293725d6d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:35.169334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f66da-2e38-4020-814e-353293725d6d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:35.171446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f66da-2e38-4020-814e-353293725d6d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:35.184353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88d3c9-6ee8-4fb4-8a00-f4662d1c5437 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-6c5f66da-2e38-4020-814e-353293725d6d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:35.192148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:35.193030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:35.193923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 266/525] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:35.194594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f66da-2e38-4020-814e-353293725d6d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:35.207290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:35.224359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:35.235245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3137c-b423-465b-b8db-a9d3802a18d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:35.236163 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3137c-b423-465b-b8db-a9d3802a18d6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:35.236505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3137c-b423-465b-b8db-a9d3802a18d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:35.236904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3137c-b423-465b-b8db-a9d3802a18d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:35.248398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3137c-b423-465b-b8db-a9d3802a18d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:35.249890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3137c-b423-465b-b8db-a9d3802a18d6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-dcb3137c-b423-465b-b8db-a9d3802a18d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:35.270152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:35.271052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:35.277155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:35.277155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:35.277155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:35.277155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:35.277155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 260/526] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:35.277155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3137c-b423-465b-b8db-a9d3802a18d6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:35.325344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f66da-2e38-4020-814e-353293725d6d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:35.370361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258d05e-cb17-4aa7-adbf-3437ce37eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:35.371120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d05e-cb17-4aa7-adbf-3437ce37eead None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:35.371510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d05e-cb17-4aa7-adbf-3437ce37eead None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:35.371870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d05e-cb17-4aa7-adbf-3437ce37eead None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:35.372967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258d05e-cb17-4aa7-adbf-3437ce37eead None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:35.373350 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258d05e-cb17-4aa7-adbf-3437ce37eead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:35.375324 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258d05e-cb17-4aa7-adbf-3437ce37eead None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:35.390492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3137c-b423-465b-b8db-a9d3802a18d6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:35.394017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 267/527] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:35.395180 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258d05e-cb17-4aa7-adbf-3437ce37eead None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:35.439445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f71fd-2ae0-4918-b363-f2a7ceeb70cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:35.440472 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f71fd-2ae0-4918-b363-f2a7ceeb70cf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:35.440828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f71fd-2ae0-4918-b363-f2a7ceeb70cf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:35.441186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f71fd-2ae0-4918-b363-f2a7ceeb70cf None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:35.442407 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f71fd-2ae0-4918-b363-f2a7ceeb70cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:35.442791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f71fd-2ae0-4918-b363-f2a7ceeb70cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:35.445350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f71fd-2ae0-4918-b363-f2a7ceeb70cf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:35.479751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:35.502076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 261/528] 10.222.0.46 () {56 vars in 1139 bytes} [Tue Jun 21 15:44:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:35.502076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f71fd-2ae0-4918-b363-f2a7ceeb70cf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:35.525848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258d05e-cb17-4aa7-adbf-3437ce37eead None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:35.541329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:35.571696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05264dda-6d38-48ea-b42d-ab7b3fda17d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:35.572518 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05264dda-6d38-48ea-b42d-ab7b3fda17d0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:35.572812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05264dda-6d38-48ea-b42d-ab7b3fda17d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:35.573095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05264dda-6d38-48ea-b42d-ab7b3fda17d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:35.573826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05264dda-6d38-48ea-b42d-ab7b3fda17d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:35.574169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05264dda-6d38-48ea-b42d-ab7b3fda17d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:35.576288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05264dda-6d38-48ea-b42d-ab7b3fda17d0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:35.590650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 268/529] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:35.597290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05264dda-6d38-48ea-b42d-ab7b3fda17d0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:35.624243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f71fd-2ae0-4918-b363-f2a7ceeb70cf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:35.662886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed8d7-af4c-4213-bd6f-68a8d5068cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:35.663763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed8d7-af4c-4213-bd6f-68a8d5068cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:35.664060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed8d7-af4c-4213-bd6f-68a8d5068cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:35.664971 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed8d7-af4c-4213-bd6f-68a8d5068cb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:35.673217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ed8d7-af4c-4213-bd6f-68a8d5068cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:35.674894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ed8d7-af4c-4213-bd6f-68a8d5068cb4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f86ed8d7-af4c-4213-bd6f-68a8d5068cb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:35.692225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:35.693122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:35.693963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:35.693963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:35.693963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:35.693963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:35.693963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:35.693963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:35.693963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:35.693963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:35.695000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 262/530] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:35.695000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed8d7-af4c-4213-bd6f-68a8d5068cb4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:35.728857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05264dda-6d38-48ea-b42d-ab7b3fda17d0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:35.757147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:35.766103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6a490-4973-452b-8d4a-7944927b5cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:35.767116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6a490-4973-452b-8d4a-7944927b5cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:35.767671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6a490-4973-452b-8d4a-7944927b5cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:35.768165 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6a490-4973-452b-8d4a-7944927b5cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:35.807719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:35.815963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed8d7-af4c-4213-bd6f-68a8d5068cb4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:35.841805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6a490-4973-452b-8d4a-7944927b5cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:35.843632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6a490-4973-452b-8d4a-7944927b5cc9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:35.854778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e85b-3a0f-492d-a8b5-43d998e2f1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:35.855624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e85b-3a0f-492d-a8b5-43d998e2f1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:35.855917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e85b-3a0f-492d-a8b5-43d998e2f1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:35.856201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e85b-3a0f-492d-a8b5-43d998e2f1d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:35.864581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286e85b-3a0f-492d-a8b5-43d998e2f1d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:35.866151 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286e85b-3a0f-492d-a8b5-43d998e2f1d7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8286e85b-3a0f-492d-a8b5-43d998e2f1d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:35.885281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:35.886143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:35.886979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:35.886979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:35.886979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:35.886979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:35.886979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:35.886979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:35.886979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:35.886979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:35.891409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 263/531] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:35.892814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e85b-3a0f-492d-a8b5-43d998e2f1d7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:35.968110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 269/532] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:35.969658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6a490-4973-452b-8d4a-7944927b5cc9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:35.999568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:36.009263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e85b-3a0f-492d-a8b5-43d998e2f1d7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:36.048650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dabf45-cccc-4dc3-b30e-ddbb58b7952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:36.049321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dabf45-cccc-4dc3-b30e-ddbb58b7952b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.049621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dabf45-cccc-4dc3-b30e-ddbb58b7952b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.049906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dabf45-cccc-4dc3-b30e-ddbb58b7952b None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.050706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dabf45-cccc-4dc3-b30e-ddbb58b7952b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:36.051022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dabf45-cccc-4dc3-b30e-ddbb58b7952b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:36.052533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dabf45-cccc-4dc3-b30e-ddbb58b7952b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:36.065279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 264/533] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:36.066563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080d4f1-bc45-46e6-a3dc-31b28de3150d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.066859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080d4f1-bc45-46e6-a3dc-31b28de3150d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.067144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080d4f1-bc45-46e6-a3dc-31b28de3150d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.068612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 265/534] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:36.069243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080d4f1-bc45-46e6-a3dc-31b28de3150d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:36.090173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:36.094917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6a490-4973-452b-8d4a-7944927b5cc9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:36.134224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df782-be27-4e4d-8738-3c91a423dfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:36.134905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df782-be27-4e4d-8738-3c91a423dfee None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.135276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df782-be27-4e4d-8738-3c91a423dfee None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.135617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df782-be27-4e4d-8738-3c91a423dfee None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.136363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83df782-be27-4e4d-8738-3c91a423dfee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:36.136680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83df782-be27-4e4d-8738-3c91a423dfee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:36.138150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83df782-be27-4e4d-8738-3c91a423dfee None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:36.158085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 270/535] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:36.158806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df782-be27-4e4d-8738-3c91a423dfee None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:36.193940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080d4f1-bc45-46e6-a3dc-31b28de3150d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:36.233020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b0885-f103-49c0-912a-b7af45961c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:36.233821 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b0885-f103-49c0-912a-b7af45961c61 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.234112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b0885-f103-49c0-912a-b7af45961c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.234392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b0885-f103-49c0-912a-b7af45961c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.247190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b0885-f103-49c0-912a-b7af45961c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:36.248961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b0885-f103-49c0-912a-b7af45961c61 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:36.260396 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-da2b0885-f103-49c0-912a-b7af45961c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:36.269262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:36.270098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:36.270970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:36.270970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:36.270970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:36.270970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:36.270970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 266/536] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:36.272445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d5209-199f-4255-b8b0-8cef33ea377d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.272743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d5209-199f-4255-b8b0-8cef33ea377d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.273033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d5209-199f-4255-b8b0-8cef33ea377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.279038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df782-be27-4e4d-8738-3c91a423dfee None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:36.294637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fe5d5209-199f-4255-b8b0-8cef33ea377d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:36.296001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fe5d5209-199f-4255-b8b0-8cef33ea377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:36.316627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da278ec-bb58-4abc-988b-2e1203f7abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:36.317289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da278ec-bb58-4abc-988b-2e1203f7abf9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.317585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da278ec-bb58-4abc-988b-2e1203f7abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.317870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da278ec-bb58-4abc-988b-2e1203f7abf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.318773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da278ec-bb58-4abc-988b-2e1203f7abf9 None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=6087f9fd3f814573a243f983faf0ce5b) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:36.319025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da278ec-bb58-4abc-988b-2e1203f7abf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:36.320531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da278ec-bb58-4abc-988b-2e1203f7abf9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:36.326767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 271/537] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:36 2022] GET /identity/v3/role_assignments?user.id=6087f9fd3f814573a243f983faf0ce5b&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:36.327623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da278ec-bb58-4abc-988b-2e1203f7abf9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:36.390874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:36.397636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 267/538] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:36.407773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d5209-199f-4255-b8b0-8cef33ea377d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:36.478669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da278ec-bb58-4abc-988b-2e1203f7abf9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:36.518195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3ad83-e774-46ae-bb9c-a9862bbac53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:36.519255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3ad83-e774-46ae-bb9c-a9862bbac53d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.519720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3ad83-e774-46ae-bb9c-a9862bbac53d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.520001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3ad83-e774-46ae-bb9c-a9862bbac53d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.520842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3ad83-e774-46ae-bb9c-a9862bbac53d None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=61565364dbac41cfac76195c0be88771) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:36.521184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3ad83-e774-46ae-bb9c-a9862bbac53d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:36.522633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3ad83-e774-46ae-bb9c-a9862bbac53d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:36.529791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 272/539] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:36 2022] GET /identity/v3/role_assignments?user.id=61565364dbac41cfac76195c0be88771&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:36.530624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3ad83-e774-46ae-bb9c-a9862bbac53d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:36.542681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d5209-199f-4255-b8b0-8cef33ea377d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:36.552824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:36.655407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3ad83-e774-46ae-bb9c-a9862bbac53d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:36.668014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09ab69-bf50-46d6-aa54-34aa8b249409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:36.669130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09ab69-bf50-46d6-aa54-34aa8b249409 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.669639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09ab69-bf50-46d6-aa54-34aa8b249409 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.670142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09ab69-bf50-46d6-aa54-34aa8b249409 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.671516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09ab69-bf50-46d6-aa54-34aa8b249409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:36.671869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09ab69-bf50-46d6-aa54-34aa8b249409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:36.674040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09ab69-bf50-46d6-aa54-34aa8b249409 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:36.700303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964bc2f-b174-4000-8202-716195fc0cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:36.701187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964bc2f-b174-4000-8202-716195fc0cbb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.701474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964bc2f-b174-4000-8202-716195fc0cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.701785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964bc2f-b174-4000-8202-716195fc0cbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.714256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 268/540] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:36.715283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964bc2f-b174-4000-8202-716195fc0cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:36.728534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09ab69-bf50-46d6-aa54-34aa8b249409 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-3964bc2f-b174-4000-8202-716195fc0cbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:36.728728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:36.729585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:36.730363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:36.730958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 273/541] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:36.736358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964bc2f-b174-4000-8202-716195fc0cbb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:36.834039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:36.834684 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:36.860989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964bc2f-b174-4000-8202-716195fc0cbb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:36.913409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09ab69-bf50-46d6-aa54-34aa8b249409 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:36.917394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828b94-0b4e-4a7b-a2b5-142a9da37fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:36.918120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828b94-0b4e-4a7b-a2b5-142a9da37fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.918414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828b94-0b4e-4a7b-a2b5-142a9da37fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.918713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828b94-0b4e-4a7b-a2b5-142a9da37fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.919550 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828b94-0b4e-4a7b-a2b5-142a9da37fb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:36.919885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828b94-0b4e-4a7b-a2b5-142a9da37fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:36.921341 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828b94-0b4e-4a7b-a2b5-142a9da37fb8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:36.946019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 274/542] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:36.948531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828b94-0b4e-4a7b-a2b5-142a9da37fb8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:36.973918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c2f0c-2e50-4447-8c22-ff55d99c235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:36.974728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c2f0c-2e50-4447-8c22-ff55d99c235b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:36.975016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c2f0c-2e50-4447-8c22-ff55d99c235b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:36.975321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c2f0c-2e50-4447-8c22-ff55d99c235b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:36.993226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c2f0c-2e50-4447-8c22-ff55d99c235b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:36.995016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c2f0c-2e50-4447-8c22-ff55d99c235b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-254c2f0c-2e50-4447-8c22-ff55d99c235b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:37.029521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:37.030434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:37.031321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:37.031321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:37.031321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:37.031321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:37.031321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:37.031321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:37.031321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:37.031321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:37.038368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 269/543] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:37.052932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c2f0c-2e50-4447-8c22-ff55d99c235b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:37.089409 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828b94-0b4e-4a7b-a2b5-142a9da37fb8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:37.135985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b80742-64e1-48e2-b885-16a83c08ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:37.136874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80742-64e1-48e2-b885-16a83c08ef6e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:37.137164 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80742-64e1-48e2-b885-16a83c08ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:37.137446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80742-64e1-48e2-b885-16a83c08ef6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:37.145484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:37.155264 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b80742-64e1-48e2-b885-16a83c08ef6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:37.156840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b80742-64e1-48e2-b885-16a83c08ef6e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:37.179887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c2f0c-2e50-4447-8c22-ff55d99c235b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-05b80742-64e1-48e2-b885-16a83c08ef6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:37.191753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:37.192646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:37.193491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:37.193491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:37.193491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:37.193491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:37.193491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 275/544] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:37.199351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b80742-64e1-48e2-b885-16a83c08ef6e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:37.204496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:37.235480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf74a3-e634-48bd-881a-a8013f9a4e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:37.236438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf74a3-e634-48bd-881a-a8013f9a4e5f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:37.236862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf74a3-e634-48bd-881a-a8013f9a4e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:37.237276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf74a3-e634-48bd-881a-a8013f9a4e5f None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:37.238201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf74a3-e634-48bd-881a-a8013f9a4e5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:37.238668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf74a3-e634-48bd-881a-a8013f9a4e5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:37.240272 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf74a3-e634-48bd-881a-a8013f9a4e5f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:37.253790 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 270/545] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:37.259463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecefa9-8c72-4013-9ca5-38b227e1050e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:37.259961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecefa9-8c72-4013-9ca5-38b227e1050e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:37.260408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecefa9-8c72-4013-9ca5-38b227e1050e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:37.262176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 271/546] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:37.264882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecefa9-8c72-4013-9ca5-38b227e1050e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:37.333066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b80742-64e1-48e2-b885-16a83c08ef6e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:37.369212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e9a8b-4cb3-452f-b9b0-ed0b1b78bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:37.370163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e9a8b-4cb3-452f-b9b0-ed0b1b78bf9b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:37.370592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e9a8b-4cb3-452f-b9b0-ed0b1b78bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:37.371011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e9a8b-4cb3-452f-b9b0-ed0b1b78bf9b None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:37.371910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e9a8b-4cb3-452f-b9b0-ed0b1b78bf9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:37.372357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e9a8b-4cb3-452f-b9b0-ed0b1b78bf9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:37.373888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e9a8b-4cb3-452f-b9b0-ed0b1b78bf9b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:37.387439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 276/547] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:37.393561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92df78-c082-44e9-a468-f53a80258e15 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:37.394079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92df78-c082-44e9-a468-f53a80258e15 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:37.394496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92df78-c082-44e9-a468-f53a80258e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:37.397113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecefa9-8c72-4013-9ca5-38b227e1050e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:37.419416 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4c92df78-c082-44e9-a468-f53a80258e15 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:37.420865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4c92df78-c082-44e9-a468-f53a80258e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:37.442062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a87059-65c7-4031-b17a-29c9ac914907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:37.442706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a87059-65c7-4031-b17a-29c9ac914907 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:37.443039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a87059-65c7-4031-b17a-29c9ac914907 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:37.443361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a87059-65c7-4031-b17a-29c9ac914907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:37.444206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a87059-65c7-4031-b17a-29c9ac914907 None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2d3018419d0548eda04b3539681f3df5) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:37.444560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a87059-65c7-4031-b17a-29c9ac914907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:37.447490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a87059-65c7-4031-b17a-29c9ac914907 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:37.455589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 272/548] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:37 2022] GET /identity/v3/role_assignments?user.id=2d3018419d0548eda04b3539681f3df5&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:37.457238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a87059-65c7-4031-b17a-29c9ac914907 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:37.498087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:37.545731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 277/549] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:37.557466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:37.591660 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92df78-c082-44e9-a468-f53a80258e15 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:37.649656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a87059-65c7-4031-b17a-29c9ac914907 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:37.724028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520dfc4-6e93-4b4e-8a4e-b1647b86845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:37.724761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520dfc4-6e93-4b4e-8a4e-b1647b86845c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:37.725051 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520dfc4-6e93-4b4e-8a4e-b1647b86845c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:37.725330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520dfc4-6e93-4b4e-8a4e-b1647b86845c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:37.740345 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520dfc4-6e93-4b4e-8a4e-b1647b86845c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:37.745188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520dfc4-6e93-4b4e-8a4e-b1647b86845c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c520dfc4-6e93-4b4e-8a4e-b1647b86845c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:37.768148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:37.769603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:37.771660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 273/550] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:44:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:37.783383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520dfc4-6e93-4b4e-8a4e-b1647b86845c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:37.793853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92df78-c082-44e9-a468-f53a80258e15 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:37.871958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e5df-36f5-49e8-b3b9-27ee3d28a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:37.873211 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e5df-36f5-49e8-b3b9-27ee3d28a586 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:37.873712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e5df-36f5-49e8-b3b9-27ee3d28a586 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:37.874210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e5df-36f5-49e8-b3b9-27ee3d28a586 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:37.896412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583e5df-36f5-49e8-b3b9-27ee3d28a586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-4583e5df-36f5-49e8-b3b9-27ee3d28a586 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:37.913482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:37.914791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:37.915802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:37.924546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 278/551] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:37.928739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520dfc4-6e93-4b4e-8a4e-b1647b86845c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:37.943572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:37.944519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e5df-36f5-49e8-b3b9-27ee3d28a586 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:37.968579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e753bc-ec3b-432a-8269-909648121040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:37.969321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e753bc-ec3b-432a-8269-909648121040 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:37.969611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e753bc-ec3b-432a-8269-909648121040 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:37.969942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e753bc-ec3b-432a-8269-909648121040 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:37.970792 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e753bc-ec3b-432a-8269-909648121040 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:37.971102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e753bc-ec3b-432a-8269-909648121040 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:37.972558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e753bc-ec3b-432a-8269-909648121040 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:37.990979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 274/552] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jun 21 15:44:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:37.996375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e753bc-ec3b-432a-8269-909648121040 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:38.024412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:38.100917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e753bc-ec3b-432a-8269-909648121040 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:38.141739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7739f-68c1-422c-a0fc-a427fe7a03b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:38.142400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7739f-68c1-422c-a0fc-a427fe7a03b2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:38.142686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7739f-68c1-422c-a0fc-a427fe7a03b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:38.142962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7739f-68c1-422c-a0fc-a427fe7a03b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:38.177812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:38.189391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e5df-36f5-49e8-b3b9-27ee3d28a586 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:38.215592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7739f-68c1-422c-a0fc-a427fe7a03b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:38.218250 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7739f-68c1-422c-a0fc-a427fe7a03b2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:38.276885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6aed5-8562-48d9-b9c5-9db182913c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:38.277594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6aed5-8562-48d9-b9c5-9db182913c90 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:38.277888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6aed5-8562-48d9-b9c5-9db182913c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:38.278172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6aed5-8562-48d9-b9c5-9db182913c90 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:38.278936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6aed5-8562-48d9-b9c5-9db182913c90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:38.279282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6aed5-8562-48d9-b9c5-9db182913c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:38.280698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6aed5-8562-48d9-b9c5-9db182913c90 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:38.299087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 279/553] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:38.308220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6aed5-8562-48d9-b9c5-9db182913c90 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:38.328377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 275/554] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 15:44:38.333900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7739f-68c1-422c-a0fc-a427fe7a03b2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:38.419579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:38.473072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6aed5-8562-48d9-b9c5-9db182913c90 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:38.475450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:38.515326 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7739f-68c1-422c-a0fc-a427fe7a03b2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:38.549960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96e8e4-25ee-4b82-abae-a6678b38fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:38.550695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96e8e4-25ee-4b82-abae-a6678b38fc1c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:38.550986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96e8e4-25ee-4b82-abae-a6678b38fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:38.551292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96e8e4-25ee-4b82-abae-a6678b38fc1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:38.566595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96e8e4-25ee-4b82-abae-a6678b38fc1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:38.568086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96e8e4-25ee-4b82-abae-a6678b38fc1c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:38.586257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c29583-fa6c-44e1-ae34-685288203e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:38.587191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29583-fa6c-44e1-ae34-685288203e9a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:38.587481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29583-fa6c-44e1-ae34-685288203e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:38.587761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29583-fa6c-44e1-ae34-685288203e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-4d96e8e4-25ee-4b82-abae-a6678b38fc1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:38.598949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:38.600973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:38.603568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:38.603568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:38.603568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:38.603568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:38.609989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c29583-fa6c-44e1-ae34-685288203e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:38.611733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c29583-fa6c-44e1-ae34-685288203e9a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:38.612199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 280/555] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:38.615450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96e8e4-25ee-4b82-abae-a6678b38fc1c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d1c29583-fa6c-44e1-ae34-685288203e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:38.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:38.646204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:38.648132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:38.648132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:38.648132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:38.648132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:38.648132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 276/556] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:38.653179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c29583-fa6c-44e1-ae34-685288203e9a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:38.730777 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96e8e4-25ee-4b82-abae-a6678b38fc1c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:38.769223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675add56-92c1-4bd8-8f61-2458a7366ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:38.769989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675add56-92c1-4bd8-8f61-2458a7366ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:38.770330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675add56-92c1-4bd8-8f61-2458a7366ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:38.770650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675add56-92c1-4bd8-8f61-2458a7366ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:38.771493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675add56-92c1-4bd8-8f61-2458a7366ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:38.771845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675add56-92c1-4bd8-8f61-2458a7366ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:38.773308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675add56-92c1-4bd8-8f61-2458a7366ef6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:38.787548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 281/557] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:38.793291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675add56-92c1-4bd8-8f61-2458a7366ef6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:38.811671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:38.872004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c29583-fa6c-44e1-ae34-685288203e9a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:38.891834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:38.912512 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675add56-92c1-4bd8-8f61-2458a7366ef6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:38.919926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35280eb-8d4d-4475-8cdb-069ab9982daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:38.920979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35280eb-8d4d-4475-8cdb-069ab9982daa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:38.921483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35280eb-8d4d-4475-8cdb-069ab9982daa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:38.921943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35280eb-8d4d-4475-8cdb-069ab9982daa None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:38.923010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35280eb-8d4d-4475-8cdb-069ab9982daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:38.923359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35280eb-8d4d-4475-8cdb-069ab9982daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:38.924898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35280eb-8d4d-4475-8cdb-069ab9982daa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:38.939962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 277/558] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:38.941329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec5fd-0aad-4b8c-96b2-bc088432ea82 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:38.941665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec5fd-0aad-4b8c-96b2-bc088432ea82 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:38.941890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec5fd-0aad-4b8c-96b2-bc088432ea82 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:38.948471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 278/559] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:38.948471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99760-6eca-4a09-9725-11b090c69327 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:38.948471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99760-6eca-4a09-9725-11b090c69327 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:38.948471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99760-6eca-4a09-9725-11b090c69327 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:38.948471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 279/560] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:38.948471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f99760-6eca-4a09-9725-11b090c69327 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:38.975816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dfa13-5314-4a0a-a7d2-33fe8930ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:38.976547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dfa13-5314-4a0a-a7d2-33fe8930ab3d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:38.976909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dfa13-5314-4a0a-a7d2-33fe8930ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:38.977190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dfa13-5314-4a0a-a7d2-33fe8930ab3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:38.985341 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dfa13-5314-4a0a-a7d2-33fe8930ab3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:38.986794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dfa13-5314-4a0a-a7d2-33fe8930ab3d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-646dfa13-5314-4a0a-a7d2-33fe8930ab3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:39.001851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:39.003894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 282/561] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jun 21 15:44:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f8e8d-084a-438c-bdaf-9c03b4c1af9c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.005282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f8e8d-084a-438c-bdaf-9c03b4c1af9c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.007311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f8e8d-084a-438c-bdaf-9c03b4c1af9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.024247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9b5f8e8d-084a-438c-bdaf-9c03b4c1af9c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:39.025550 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9b5f8e8d-084a-438c-bdaf-9c03b4c1af9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:39.067361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f99760-6eca-4a09-9725-11b090c69327 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:39.103834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19cdd5-6872-43f8-ae53-8fbe409b5174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:39.104746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19cdd5-6872-43f8-ae53-8fbe409b5174 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.105111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19cdd5-6872-43f8-ae53-8fbe409b5174 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.105322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19cdd5-6872-43f8-ae53-8fbe409b5174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.115448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 283/562] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:39.115448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad76000-2aba-4d6c-ac23-aa6f03a09bb8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.115448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad76000-2aba-4d6c-ac23-aa6f03a09bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.115448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad76000-2aba-4d6c-ac23-aa6f03a09bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.115785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19cdd5-6872-43f8-ae53-8fbe409b5174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:39.115785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19cdd5-6872-43f8-ae53-8fbe409b5174 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:39.122056 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4c19cdd5-6872-43f8-ae53-8fbe409b5174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:39.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:39.132489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:39.133398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:39.133398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:39.133398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:39.133398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:39.133398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:39.133398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:39.133398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:39.133398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:39.133398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 280/563] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:39.134322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19cdd5-6872-43f8-ae53-8fbe409b5174 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:39.139384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5ad76000-2aba-4d6c-ac23-aa6f03a09bb8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:39.140986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5ad76000-2aba-4d6c-ac23-aa6f03a09bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:39.170294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:39.228872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 284/564] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:39.230359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad76000-2aba-4d6c-ac23-aa6f03a09bb8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:39.268158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19cdd5-6872-43f8-ae53-8fbe409b5174 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:39.308627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63f452-370f-4de0-a2fa-1feceed13ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:39.309316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f452-370f-4de0-a2fa-1feceed13ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.309608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f452-370f-4de0-a2fa-1feceed13ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.309893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f452-370f-4de0-a2fa-1feceed13ba0 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.310746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63f452-370f-4de0-a2fa-1feceed13ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:39.311060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63f452-370f-4de0-a2fa-1feceed13ba0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:39.312552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63f452-370f-4de0-a2fa-1feceed13ba0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:39.331835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 281/565] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jun 21 15:44:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:39.332969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63f452-370f-4de0-a2fa-1feceed13ba0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:39.361825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad76000-2aba-4d6c-ac23-aa6f03a09bb8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:39.400651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580af6ff-3f4d-4c8b-a9a1-b34304dd75fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:39.401473 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580af6ff-3f4d-4c8b-a9a1-b34304dd75fa None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.401765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580af6ff-3f4d-4c8b-a9a1-b34304dd75fa None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.402050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580af6ff-3f4d-4c8b-a9a1-b34304dd75fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.404652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:39.415576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580af6ff-3f4d-4c8b-a9a1-b34304dd75fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-580af6ff-3f4d-4c8b-a9a1-b34304dd75fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:39.423507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:39.424418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:39.425278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 285/566] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:39.425964 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580af6ff-3f4d-4c8b-a9a1-b34304dd75fa None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:39.444916 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:39.456609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63f452-370f-4de0-a2fa-1feceed13ba0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:39.494898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f20f74-562c-4975-b6cf-54a060405f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:39.495600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f20f74-562c-4975-b6cf-54a060405f3e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.495889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f20f74-562c-4975-b6cf-54a060405f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.496173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f20f74-562c-4975-b6cf-54a060405f3e None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.496989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f20f74-562c-4975-b6cf-54a060405f3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:39.497336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f20f74-562c-4975-b6cf-54a060405f3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:39.498882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f20f74-562c-4975-b6cf-54a060405f3e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:39.516294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 282/567] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:39.516294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f20f74-562c-4975-b6cf-54a060405f3e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:39.545418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580af6ff-3f4d-4c8b-a9a1-b34304dd75fa None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:39.583310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12384878-f322-4c93-b4f6-15f671310858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:39.584380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12384878-f322-4c93-b4f6-15f671310858 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.584841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12384878-f322-4c93-b4f6-15f671310858 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.585153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12384878-f322-4c93-b4f6-15f671310858 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.597613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12384878-f322-4c93-b4f6-15f671310858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-12384878-f322-4c93-b4f6-15f671310858 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:39.608183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:39.609176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 286/568] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:39.610614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12384878-f322-4c93-b4f6-15f671310858 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:39.643612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f20f74-562c-4975-b6cf-54a060405f3e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:39.673989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:39.688654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7e38c-de60-4b8d-bb03-dfe32608753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:39.689569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7e38c-de60-4b8d-bb03-dfe32608753e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.690605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7e38c-de60-4b8d-bb03-dfe32608753e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.690605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7e38c-de60-4b8d-bb03-dfe32608753e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.703294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7e38c-de60-4b8d-bb03-dfe32608753e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:39.704762 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7e38c-de60-4b8d-bb03-dfe32608753e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:39.720892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12384878-f322-4c93-b4f6-15f671310858 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f4e7e38c-de60-4b8d-bb03-dfe32608753e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:39.724122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:39.725017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:39.725943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:39.725943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:39.725943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:39.725943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:39.725943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 283/569] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:39.726730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7e38c-de60-4b8d-bb03-dfe32608753e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:39.730595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:39.761234 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ee47b-f0de-4c40-9a01-ef42d0052d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:39.761915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ee47b-f0de-4c40-9a01-ef42d0052d7f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.762202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ee47b-f0de-4c40-9a01-ef42d0052d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.762494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ee47b-f0de-4c40-9a01-ef42d0052d7f None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.763278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ee47b-f0de-4c40-9a01-ef42d0052d7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:39.763854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ee47b-f0de-4c40-9a01-ef42d0052d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:39.765261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ee47b-f0de-4c40-9a01-ef42d0052d7f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:39.774333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 287/570] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:39.775126 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ee47b-f0de-4c40-9a01-ef42d0052d7f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:39.846221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7e38c-de60-4b8d-bb03-dfe32608753e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:39.885240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9736794-4951-415a-9a4c-cec0a2979af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:39.885916 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9736794-4951-415a-9a4c-cec0a2979af4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.886215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9736794-4951-415a-9a4c-cec0a2979af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.886498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9736794-4951-415a-9a4c-cec0a2979af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.887376 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9736794-4951-415a-9a4c-cec0a2979af4 None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=35ec9ea691c141eb86bf7a825fbb80ed) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:39.887695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9736794-4951-415a-9a4c-cec0a2979af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:39.888219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ee47b-f0de-4c40-9a01-ef42d0052d7f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:39.889393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9736794-4951-415a-9a4c-cec0a2979af4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:39.895815 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 284/571] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:39 2022] GET /identity/v3/role_assignments?user.id=35ec9ea691c141eb86bf7a825fbb80ed&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:39.896079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9736794-4951-415a-9a4c-cec0a2979af4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:39.905519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:39.933826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2d3f-1fc8-4711-ae39-6cf3bc99dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:39.934827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2d3f-1fc8-4711-ae39-6cf3bc99dc9e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:39.935115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2d3f-1fc8-4711-ae39-6cf3bc99dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:39.935425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2d3f-1fc8-4711-ae39-6cf3bc99dc9e None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:39.936220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2d3f-1fc8-4711-ae39-6cf3bc99dc9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:39.936535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2d3f-1fc8-4711-ae39-6cf3bc99dc9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:39.938634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2d3f-1fc8-4711-ae39-6cf3bc99dc9e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:39.949415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 288/572] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:39.950133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2d3f-1fc8-4711-ae39-6cf3bc99dc9e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:39.989056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:40.028705 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9736794-4951-415a-9a4c-cec0a2979af4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:40.070323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ae38e-c0fd-4710-b582-f457cbfa0d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:40.071013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ae38e-c0fd-4710-b582-f457cbfa0d1b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.071566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ae38e-c0fd-4710-b582-f457cbfa0d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.071853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ae38e-c0fd-4710-b582-f457cbfa0d1b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.072595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ae38e-c0fd-4710-b582-f457cbfa0d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:40.072800 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2d3f-1fc8-4711-ae39-6cf3bc99dc9e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:40.072912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ae38e-c0fd-4710-b582-f457cbfa0d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:40.074356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ae38e-c0fd-4710-b582-f457cbfa0d1b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:40.087573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 285/573] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:40.089120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe2aeb-ab0d-4a6f-870d-0c6db3a3b563 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.089414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe2aeb-ab0d-4a6f-870d-0c6db3a3b563 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.089701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe2aeb-ab0d-4a6f-870d-0c6db3a3b563 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.094983 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 286/574] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:40.094983 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe2aeb-ab0d-4a6f-870d-0c6db3a3b563 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:40.118165 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d612ead-11e4-482a-a08a-c044ed7922bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:40.118934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d612ead-11e4-482a-a08a-c044ed7922bc None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.119258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d612ead-11e4-482a-a08a-c044ed7922bc None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.119544 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d612ead-11e4-482a-a08a-c044ed7922bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.132233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d612ead-11e4-482a-a08a-c044ed7922bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:40.134254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d612ead-11e4-482a-a08a-c044ed7922bc None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9d612ead-11e4-482a-a08a-c044ed7922bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:40.154731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:40.155878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:40.161456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:40.161456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:40.161456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:40.161456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:40.161456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 289/575] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:40.161456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d612ead-11e4-482a-a08a-c044ed7922bc None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:40.194730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:40.223193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe2aeb-ab0d-4a6f-870d-0c6db3a3b563 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:40.252518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:40.263077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e25c67-a1d7-4381-8ef9-94ed0ece8bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:40.264171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25c67-a1d7-4381-8ef9-94ed0ece8bfd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.264461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25c67-a1d7-4381-8ef9-94ed0ece8bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.264737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25c67-a1d7-4381-8ef9-94ed0ece8bfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.276182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e25c67-a1d7-4381-8ef9-94ed0ece8bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:40.277651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e25c67-a1d7-4381-8ef9-94ed0ece8bfd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:40.280327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d612ead-11e4-482a-a08a-c044ed7922bc None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c4e25c67-a1d7-4381-8ef9-94ed0ece8bfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:40.296608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:40.297536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:40.298416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:40.298416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:40.298416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:40.298416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:40.298416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 287/576] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:40.299142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c970d9e-8b0c-493d-afa1-45d4bc2deccf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.299459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c970d9e-8b0c-493d-afa1-45d4bc2deccf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.299696 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c970d9e-8b0c-493d-afa1-45d4bc2deccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.317792 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0c970d9e-8b0c-493d-afa1-45d4bc2deccf None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:40.319223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0c970d9e-8b0c-493d-afa1-45d4bc2deccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:40.323978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b9393-c79b-4a6d-8b5b-63a5fb69956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:40.324785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b9393-c79b-4a6d-8b5b-63a5fb69956d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.325076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b9393-c79b-4a6d-8b5b-63a5fb69956d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.325360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b9393-c79b-4a6d-8b5b-63a5fb69956d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.332407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b9393-c79b-4a6d-8b5b-63a5fb69956d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:40.333869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b9393-c79b-4a6d-8b5b-63a5fb69956d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-1e7b9393-c79b-4a6d-8b5b-63a5fb69956d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:40.349927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:40.350860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:40.352402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:40.352402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:40.352402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:40.352402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:40.352402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:40.352402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:40.352402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:40.352402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:40.352402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 290/577] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:40.352898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b9393-c79b-4a6d-8b5b-63a5fb69956d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:40.403121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 288/578] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:40.403914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c970d9e-8b0c-493d-afa1-45d4bc2deccf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:40.461580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:40.473632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b9393-c79b-4a6d-8b5b-63a5fb69956d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:40.514645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb311f-2e29-4a64-87c2-4b024dbb5c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:40.515578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb311f-2e29-4a64-87c2-4b024dbb5c0b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.516154 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb311f-2e29-4a64-87c2-4b024dbb5c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.516688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb311f-2e29-4a64-87c2-4b024dbb5c0b None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.517567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb311f-2e29-4a64-87c2-4b024dbb5c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:40.518017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb311f-2e29-4a64-87c2-4b024dbb5c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:40.519583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c970d9e-8b0c-493d-afa1-45d4bc2deccf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:40.519746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb311f-2e29-4a64-87c2-4b024dbb5c0b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:40.529631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:40.533840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 291/579] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:40.535436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb311f-2e29-4a64-87c2-4b024dbb5c0b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:40.557635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43565e9b-b6b4-4095-8f3e-9056c3ecd773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:40.558338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565e9b-b6b4-4095-8f3e-9056c3ecd773 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.558625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565e9b-b6b4-4095-8f3e-9056c3ecd773 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.558930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565e9b-b6b4-4095-8f3e-9056c3ecd773 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.559689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43565e9b-b6b4-4095-8f3e-9056c3ecd773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:40.559996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43565e9b-b6b4-4095-8f3e-9056c3ecd773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:40.561384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43565e9b-b6b4-4095-8f3e-9056c3ecd773 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:40.574543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 289/580] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:40.576124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43565e9b-b6b4-4095-8f3e-9056c3ecd773 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:40.649055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb311f-2e29-4a64-87c2-4b024dbb5c0b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:40.685538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00895d0-677d-4d15-a421-d26627b8ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:40.686211 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00895d0-677d-4d15-a421-d26627b8ea01 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.686497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00895d0-677d-4d15-a421-d26627b8ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.686778 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00895d0-677d-4d15-a421-d26627b8ea01 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.687601 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00895d0-677d-4d15-a421-d26627b8ea01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:40.687976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00895d0-677d-4d15-a421-d26627b8ea01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:40.689451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00895d0-677d-4d15-a421-d26627b8ea01 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:40.694883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43565e9b-b6b4-4095-8f3e-9056c3ecd773 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:40.706957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 292/581] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:40.706957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00895d0-677d-4d15-a421-d26627b8ea01 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:40.717855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:40.738936 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c8e96-bcc3-448f-979e-2e84fe58a7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:40.739769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c8e96-bcc3-448f-979e-2e84fe58a7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.740059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c8e96-bcc3-448f-979e-2e84fe58a7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.740341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c8e96-bcc3-448f-979e-2e84fe58a7e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.751819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c8e96-bcc3-448f-979e-2e84fe58a7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7b2c8e96-bcc3-448f-979e-2e84fe58a7e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:40.759905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:40.760911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:40.761740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 290/582] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:40.762412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c8e96-bcc3-448f-979e-2e84fe58a7e5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:40.794992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:40.825814 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00895d0-677d-4d15-a421-d26627b8ea01 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:40.865272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c5967-3fe7-4ef0-beea-186c48da0cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:40.866081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c5967-3fe7-4ef0-beea-186c48da0cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.866368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c5967-3fe7-4ef0-beea-186c48da0cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.866814 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c5967-3fe7-4ef0-beea-186c48da0cc0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.870181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c8e96-bcc3-448f-979e-2e84fe58a7e5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:40.874878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c5967-3fe7-4ef0-beea-186c48da0cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:40.876392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c5967-3fe7-4ef0-beea-186c48da0cc0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-dc6c5967-3fe7-4ef0-beea-186c48da0cc0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:40.893733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:40.894759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 293/583] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:40.896103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c5967-3fe7-4ef0-beea-186c48da0cc0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:40.913993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b722485-2f82-4d68-9d1a-6aae23eedc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:40.914803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b722485-2f82-4d68-9d1a-6aae23eedc2a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:40.915100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b722485-2f82-4d68-9d1a-6aae23eedc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:40.915417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b722485-2f82-4d68-9d1a-6aae23eedc2a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:40.924136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b722485-2f82-4d68-9d1a-6aae23eedc2a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:40.925761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b722485-2f82-4d68-9d1a-6aae23eedc2a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2b722485-2f82-4d68-9d1a-6aae23eedc2a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:40.946884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:40.947902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 291/584] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:40.953561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b722485-2f82-4d68-9d1a-6aae23eedc2a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:40.980495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:41.015362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c5967-3fe7-4ef0-beea-186c48da0cc0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:41.047935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:41.057691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dec63-6cb3-4de7-88bf-f8019ff97f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:41.058583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dec63-6cb3-4de7-88bf-f8019ff97f58 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:41.058983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dec63-6cb3-4de7-88bf-f8019ff97f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:41.059186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dec63-6cb3-4de7-88bf-f8019ff97f58 None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2ab989a935eb4d91a94611cededd3cf6/roles/eda252044624460d8f0580e810d06eda` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:41.069098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b722485-2f82-4d68-9d1a-6aae23eedc2a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:41.076849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394dec63-6cb3-4de7-88bf-f8019ff97f58 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=2ab989a935eb4d91a94611cededd3cf6, role_id=eda252044624460d8f0580e810d06eda)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:41.078333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394dec63-6cb3-4de7-88bf-f8019ff97f58 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:41.092721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 294/585] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:44:40 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2ab989a935eb4d91a94611cededd3cf6/roles/eda252044624460d8f0580e810d06eda => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:44:41.093563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dec63-6cb3-4de7-88bf-f8019ff97f58 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:41.119938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a576469-1b11-4e46-978d-a21ac15b6d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:41.121121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a576469-1b11-4e46-978d-a21ac15b6d05 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:41.121666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a576469-1b11-4e46-978d-a21ac15b6d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:41.122195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a576469-1b11-4e46-978d-a21ac15b6d05 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:41.123441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a576469-1b11-4e46-978d-a21ac15b6d05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:41.124046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a576469-1b11-4e46-978d-a21ac15b6d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:41.125825 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a576469-1b11-4e46-978d-a21ac15b6d05 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:41.137306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 292/586] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:41.139895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a576469-1b11-4e46-978d-a21ac15b6d05 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:41.246076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dec63-6cb3-4de7-88bf-f8019ff97f58 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:41.261435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a576469-1b11-4e46-978d-a21ac15b6d05 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:41.277173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:41.296796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814133c3-a33c-4578-bdd8-f418b7e8373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:41.297598 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814133c3-a33c-4578-bdd8-f418b7e8373d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:41.297894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814133c3-a33c-4578-bdd8-f418b7e8373d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:41.298176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814133c3-a33c-4578-bdd8-f418b7e8373d None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:41.299024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814133c3-a33c-4578-bdd8-f418b7e8373d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:41.299373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814133c3-a33c-4578-bdd8-f418b7e8373d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:41.301162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814133c3-a33c-4578-bdd8-f418b7e8373d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:41.306151 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef797-66a8-495c-b36b-a5067f030502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:41.307117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef797-66a8-495c-b36b-a5067f030502 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:41.307635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef797-66a8-495c-b36b-a5067f030502 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:41.308119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef797-66a8-495c-b36b-a5067f030502 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:41.309157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ef797-66a8-495c-b36b-a5067f030502 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:41.309698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ef797-66a8-495c-b36b-a5067f030502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:41.311382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ef797-66a8-495c-b36b-a5067f030502 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:41.320292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 295/587] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jun 21 15:44:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:41.321716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814133c3-a33c-4578-bdd8-f418b7e8373d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:41.337096 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 293/588] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jun 21 15:44:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:41.338486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef797-66a8-495c-b36b-a5067f030502 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:41.355236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:41.452238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814133c3-a33c-4578-bdd8-f418b7e8373d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:41.463736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef797-66a8-495c-b36b-a5067f030502 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:41.493868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9c90c-d90f-4390-aeeb-0c91652c484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:41.495512 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9c90c-d90f-4390-aeeb-0c91652c484e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:41.496405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9c90c-d90f-4390-aeeb-0c91652c484e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:41.496941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9c90c-d90f-4390-aeeb-0c91652c484e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:41.508700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9c90c-d90f-4390-aeeb-0c91652c484e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:41.509367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df5b17-9843-41a9-84f6-70c4644ea493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:41.510179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df5b17-9843-41a9-84f6-70c4644ea493 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:41.510466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df5b17-9843-41a9-84f6-70c4644ea493 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:41.510747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df5b17-9843-41a9-84f6-70c4644ea493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:41.511620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9c90c-d90f-4390-aeeb-0c91652c484e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:41.524624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df5b17-9843-41a9-84f6-70c4644ea493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:41.526087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df5b17-9843-41a9-84f6-70c4644ea493 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9da9c90c-d90f-4390-aeeb-0c91652c484e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:41.532681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:41.533671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:41.534613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:41.534613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:41.534613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:41.534613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:41.536691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 296/589] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:41.542106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9c90c-d90f-4390-aeeb-0c91652c484e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-59df5b17-9843-41a9-84f6-70c4644ea493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:41.545115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:41.545990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:41.546880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:41.546880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:41.546880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:41.546880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:41.546880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 294/590] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:41.547596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df5b17-9843-41a9-84f6-70c4644ea493 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:41.578722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:41.630623 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:41.666494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9c90c-d90f-4390-aeeb-0c91652c484e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:41.683052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df5b17-9843-41a9-84f6-70c4644ea493 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:41.710402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbddc3d-cd68-4672-82e3-b6ea7c384eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:41.712714 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbddc3d-cd68-4672-82e3-b6ea7c384eca None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:41.713354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbddc3d-cd68-4672-82e3-b6ea7c384eca None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:41.713858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbddc3d-cd68-4672-82e3-b6ea7c384eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:41.725736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbddc3d-cd68-4672-82e3-b6ea7c384eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:41.725935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3a241-4978-4cee-8217-88f68b190b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:41.727241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a241-4978-4cee-8217-88f68b190b9b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:41.727580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a241-4978-4cee-8217-88f68b190b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:41.727952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a241-4978-4cee-8217-88f68b190b9b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:41.728687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3a241-4978-4cee-8217-88f68b190b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:41.728998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3a241-4978-4cee-8217-88f68b190b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:41.729488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbddc3d-cd68-4672-82e3-b6ea7c384eca None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:41.730527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3a241-4978-4cee-8217-88f68b190b9b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:41.749223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 295/591] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:41.749223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3a241-4978-4cee-8217-88f68b190b9b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-cbbddc3d-cd68-4672-82e3-b6ea7c384eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:41.755282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:41.756156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:41.757046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:41.757046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:41.757046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:41.757046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:41.759105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 297/592] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:41.760143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbddc3d-cd68-4672-82e3-b6ea7c384eca None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:41.860099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:41.863648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3a241-4978-4cee-8217-88f68b190b9b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:41.883895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbddc3d-cd68-4672-82e3-b6ea7c384eca None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:41.888373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:41.906378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e3acf-893e-4b24-b890-7d2c849fb2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:41.907572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e3acf-893e-4b24-b890-7d2c849fb2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:41.908135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e3acf-893e-4b24-b890-7d2c849fb2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:41.908690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e3acf-893e-4b24-b890-7d2c849fb2e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:41.909661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e3acf-893e-4b24-b890-7d2c849fb2e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:41.910193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e3acf-893e-4b24-b890-7d2c849fb2e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:41.911954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e3acf-893e-4b24-b890-7d2c849fb2e5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:41.926118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 296/593] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:41.927463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577595-57a2-4672-87de-d6a7344bc76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:41.927610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e3acf-893e-4b24-b890-7d2c849fb2e5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:41.931984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577595-57a2-4672-87de-d6a7344bc76f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:41.931984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577595-57a2-4672-87de-d6a7344bc76f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:41.931984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9577595-57a2-4672-87de-d6a7344bc76f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:41.941204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9577595-57a2-4672-87de-d6a7344bc76f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:41.942950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9577595-57a2-4672-87de-d6a7344bc76f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-d9577595-57a2-4672-87de-d6a7344bc76f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:41.962825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:41.963876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:41.964794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:41.964794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:41.964794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:41.964794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:41.964794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:41.964794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:41.964794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:41.964794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:41.964794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:44:41.964794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:41.967263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 298/594] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:41.968277 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577595-57a2-4672-87de-d6a7344bc76f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:42.059621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e3acf-893e-4b24-b890-7d2c849fb2e5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:42.092046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9577595-57a2-4672-87de-d6a7344bc76f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:42.097333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ab6ed-41ca-4b67-8d36-235a4bfb5671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:42.097999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab6ed-41ca-4b67-8d36-235a4bfb5671 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.098285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab6ed-41ca-4b67-8d36-235a4bfb5671 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.098565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab6ed-41ca-4b67-8d36-235a4bfb5671 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.099714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ab6ed-41ca-4b67-8d36-235a4bfb5671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:42.100036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ab6ed-41ca-4b67-8d36-235a4bfb5671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:42.103657 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ab6ed-41ca-4b67-8d36-235a4bfb5671 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:42.114798 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 297/595] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:42.115482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ab6ed-41ca-4b67-8d36-235a4bfb5671 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:42.133017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bff1f3-9d7a-4d73-bc1d-6f0d34fee863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:42.133890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff1f3-9d7a-4d73-bc1d-6f0d34fee863 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.134177 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff1f3-9d7a-4d73-bc1d-6f0d34fee863 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.134453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff1f3-9d7a-4d73-bc1d-6f0d34fee863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.141771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bff1f3-9d7a-4d73-bc1d-6f0d34fee863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:42.143278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bff1f3-9d7a-4d73-bc1d-6f0d34fee863 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-87bff1f3-9d7a-4d73-bc1d-6f0d34fee863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:42.158070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:42.159071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:42.160036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:42.160036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:42.160036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:42.160036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:42.160036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:42.160036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:42.160036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:42.160036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:42.160036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 299/596] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:42.160555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185fc2e-a198-4786-9411-5518096cf97e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.161503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185fc2e-a198-4786-9411-5518096cf97e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.161503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185fc2e-a198-4786-9411-5518096cf97e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.162396 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 300/597] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:42.162951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185fc2e-a198-4786-9411-5518096cf97e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:42.165860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:42.170618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:42.228484 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ab6ed-41ca-4b67-8d36-235a4bfb5671 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:42.264173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743c1e-4a84-4d45-8b90-3b38840241f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:42.264752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743c1e-4a84-4d45-8b90-3b38840241f7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.265036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743c1e-4a84-4d45-8b90-3b38840241f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.265307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743c1e-4a84-4d45-8b90-3b38840241f7 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.266147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3743c1e-4a84-4d45-8b90-3b38840241f7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:42.266460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3743c1e-4a84-4d45-8b90-3b38840241f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:42.267925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3743c1e-4a84-4d45-8b90-3b38840241f7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:42.286563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 298/598] 10.222.0.46 () {56 vars in 1139 bytes} [Tue Jun 21 15:44:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:42.287419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743c1e-4a84-4d45-8b90-3b38840241f7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:42.296214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185fc2e-a198-4786-9411-5518096cf97e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:42.341719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dced4-a77b-4f66-ab0e-52f06fedc82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:42.342451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dced4-a77b-4f66-ab0e-52f06fedc82f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.342719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dced4-a77b-4f66-ab0e-52f06fedc82f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.342999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dced4-a77b-4f66-ab0e-52f06fedc82f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.351715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dced4-a77b-4f66-ab0e-52f06fedc82f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:42.353681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dced4-a77b-4f66-ab0e-52f06fedc82f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-001dced4-a77b-4f66-ab0e-52f06fedc82f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:42.375835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:42.376989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:42.378115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:42.378115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:42.378115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:42.378115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:42.378115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:42.378115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:42.378115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:42.378115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:42.381844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 301/599] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:42.383677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb523b-e431-4ab3-be27-3c913ba4d8d7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.383979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb523b-e431-4ab3-be27-3c913ba4d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.384253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb523b-e431-4ab3-be27-3c913ba4d8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.404294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-14eb523b-e431-4ab3-be27-3c913ba4d8d7 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:42.405189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:42.405515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-14eb523b-e431-4ab3-be27-3c913ba4d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:42.411040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743c1e-4a84-4d45-8b90-3b38840241f7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:42.449542 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459503b-4f3d-4acb-93d2-be136b2fee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:42.450216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459503b-4f3d-4acb-93d2-be136b2fee4c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.450511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459503b-4f3d-4acb-93d2-be136b2fee4c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.450794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459503b-4f3d-4acb-93d2-be136b2fee4c None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.451651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459503b-4f3d-4acb-93d2-be136b2fee4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:42.451950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459503b-4f3d-4acb-93d2-be136b2fee4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:42.453389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459503b-4f3d-4acb-93d2-be136b2fee4c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:42.465993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 299/600] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:42.466698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459503b-4f3d-4acb-93d2-be136b2fee4c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:42.474689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:42.495252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 302/601] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:42.495252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb523b-e431-4ab3-be27-3c913ba4d8d7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:42.576136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459503b-4f3d-4acb-93d2-be136b2fee4c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:42.611520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66081c-6897-4693-8f5d-89d764e87d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:42.612175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66081c-6897-4693-8f5d-89d764e87d2b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.612462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66081c-6897-4693-8f5d-89d764e87d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.612741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66081c-6897-4693-8f5d-89d764e87d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.617977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb523b-e431-4ab3-be27-3c913ba4d8d7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:42.625942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66081c-6897-4693-8f5d-89d764e87d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:42.627428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66081c-6897-4693-8f5d-89d764e87d2b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1b66081c-6897-4693-8f5d-89d764e87d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:42.645894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:42.647028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:42.648275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:42.648275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:42.648275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:42.648275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:42.648275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 300/602] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:42.648275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66081c-6897-4693-8f5d-89d764e87d2b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:42.662803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:42.672013 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc66eed-2da5-4cfb-b41f-b0ebe958c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:42.672831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc66eed-2da5-4cfb-b41f-b0ebe958c605 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.673232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc66eed-2da5-4cfb-b41f-b0ebe958c605 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.674116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc66eed-2da5-4cfb-b41f-b0ebe958c605 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.674512 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc66eed-2da5-4cfb-b41f-b0ebe958c605 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:42.674929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc66eed-2da5-4cfb-b41f-b0ebe958c605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:42.676515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc66eed-2da5-4cfb-b41f-b0ebe958c605 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:42.698782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 303/603] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:42.698782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc66eed-2da5-4cfb-b41f-b0ebe958c605 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:42.761886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:42.777791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66081c-6897-4693-8f5d-89d764e87d2b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:42.814269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07dfad-a912-4765-bcd2-bd3b72d58ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:42.815178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07dfad-a912-4765-bcd2-bd3b72d58ec6 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.815478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07dfad-a912-4765-bcd2-bd3b72d58ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.815759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07dfad-a912-4765-bcd2-bd3b72d58ec6 None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/6087f9fd3f814573a243f983faf0ce5b/roles/eda252044624460d8f0580e810d06eda` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.818063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc66eed-2da5-4cfb-b41f-b0ebe958c605 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:42.832047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07dfad-a912-4765-bcd2-bd3b72d58ec6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=6087f9fd3f814573a243f983faf0ce5b, role_id=eda252044624460d8f0580e810d06eda)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:42.833631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07dfad-a912-4765-bcd2-bd3b72d58ec6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:42.848019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 301/604] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:44:42 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/6087f9fd3f814573a243f983faf0ce5b/roles/eda252044624460d8f0580e810d06eda => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:44:42.856389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07dfad-a912-4765-bcd2-bd3b72d58ec6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:42.858474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac132-750d-420c-a679-3cc0ece319b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:42.859582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac132-750d-420c-a679-3cc0ece319b7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:42.859947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac132-750d-420c-a679-3cc0ece319b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:42.860298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac132-750d-420c-a679-3cc0ece319b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:42.881535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ac132-750d-420c-a679-3cc0ece319b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-1c3ac132-750d-420c-a679-3cc0ece319b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:42.891559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:42.892745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:42.893772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:42.896461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 304/605] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:42.897599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac132-750d-420c-a679-3cc0ece319b7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:42.952107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:43.001027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07dfad-a912-4765-bcd2-bd3b72d58ec6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:43.030119 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac132-750d-420c-a679-3cc0ece319b7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:43.046617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:43.048840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f49f08-0569-4ffd-8a91-d1eab9d4a51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:43.050353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f49f08-0569-4ffd-8a91-d1eab9d4a51d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:43.050852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f49f08-0569-4ffd-8a91-d1eab9d4a51d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:43.051624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f49f08-0569-4ffd-8a91-d1eab9d4a51d None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:43.052853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f49f08-0569-4ffd-8a91-d1eab9d4a51d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:43.053432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f49f08-0569-4ffd-8a91-d1eab9d4a51d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:43.055754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f49f08-0569-4ffd-8a91-d1eab9d4a51d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:43.070969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 302/606] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:43.072603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059b11-9435-48d2-af9e-fca9b3b73108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:43.077830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f49f08-0569-4ffd-8a91-d1eab9d4a51d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:43.078003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059b11-9435-48d2-af9e-fca9b3b73108 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:43.078003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059b11-9435-48d2-af9e-fca9b3b73108 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:43.078003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059b11-9435-48d2-af9e-fca9b3b73108 None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/61565364dbac41cfac76195c0be88771/roles/eda252044624460d8f0580e810d06eda` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:43.094254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059b11-9435-48d2-af9e-fca9b3b73108 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=61565364dbac41cfac76195c0be88771, role_id=eda252044624460d8f0580e810d06eda)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:43.096020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059b11-9435-48d2-af9e-fca9b3b73108 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:43.113320 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 305/607] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:44:42 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/61565364dbac41cfac76195c0be88771/roles/eda252044624460d8f0580e810d06eda => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:44:43.114110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059b11-9435-48d2-af9e-fca9b3b73108 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:43.226301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f49f08-0569-4ffd-8a91-d1eab9d4a51d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:43.262718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059b11-9435-48d2-af9e-fca9b3b73108 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:43.269351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:43.310474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48aaf3-6b7e-4ff1-aeda-abafb1ae99a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:43.311345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48aaf3-6b7e-4ff1-aeda-abafb1ae99a7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:43.311639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48aaf3-6b7e-4ff1-aeda-abafb1ae99a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:43.311923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48aaf3-6b7e-4ff1-aeda-abafb1ae99a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:43.314929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ceb7a-0878-4c99-a4a0-e2225acada68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:43.315656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ceb7a-0878-4c99-a4a0-e2225acada68 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:43.315946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ceb7a-0878-4c99-a4a0-e2225acada68 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:43.316229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ceb7a-0878-4c99-a4a0-e2225acada68 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:43.317008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ceb7a-0878-4c99-a4a0-e2225acada68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:43.317320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ceb7a-0878-4c99-a4a0-e2225acada68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:43.318749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ceb7a-0878-4c99-a4a0-e2225acada68 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:43.329168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48aaf3-6b7e-4ff1-aeda-abafb1ae99a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:43.330716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48aaf3-6b7e-4ff1-aeda-abafb1ae99a7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:43.338427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 303/608] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:43.339894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4da82-9e4e-40d5-b3ba-32c928e451e4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:43.340181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4da82-9e4e-40d5-b3ba-32c928e451e4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:43.340466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4da82-9e4e-40d5-b3ba-32c928e451e4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:43.346041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 304/609] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:43.348031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649d7b-8db9-40a7-8c65-c9ddf2d07bd8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:43.348331 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649d7b-8db9-40a7-8c65-c9ddf2d07bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:43.348620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d649d7b-8db9-40a7-8c65-c9ddf2d07bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7c48aaf3-6b7e-4ff1-aeda-abafb1ae99a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:43.353516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:43.354770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:43.355716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:43.355716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:43.355716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:43.355716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:43.355716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:43.355716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:43.355716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:43.355716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:43.356156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 306/610] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:43.357646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48aaf3-6b7e-4ff1-aeda-abafb1ae99a7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:43.369985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5d649d7b-8db9-40a7-8c65-c9ddf2d07bd8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:43.371237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5d649d7b-8db9-40a7-8c65-c9ddf2d07bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:43.399728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:43.460880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 305/611] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:43.461759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d649d7b-8db9-40a7-8c65-c9ddf2d07bd8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:43.519681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48aaf3-6b7e-4ff1-aeda-abafb1ae99a7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:43.567927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4661-21fb-4b53-94ec-aa0976573846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:43.568929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4661-21fb-4b53-94ec-aa0976573846 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:43.569379 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4661-21fb-4b53-94ec-aa0976573846 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:43.569826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4661-21fb-4b53-94ec-aa0976573846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:43.582039 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a4661-21fb-4b53-94ec-aa0976573846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:43.583520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a4661-21fb-4b53-94ec-aa0976573846 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f35a4661-21fb-4b53-94ec-aa0976573846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:43.601795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:43.603115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:43.604646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:43.604646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:43.604646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:43.604646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:43.604941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d649d7b-8db9-40a7-8c65-c9ddf2d07bd8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:43.605046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 307/612] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:43.607288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4661-21fb-4b53-94ec-aa0976573846 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:43.622130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:43.651354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b500cb-e826-4c5e-b06a-371f0af8efe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:43.652033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b500cb-e826-4c5e-b06a-371f0af8efe8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:43.652324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b500cb-e826-4c5e-b06a-371f0af8efe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:43.652607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b500cb-e826-4c5e-b06a-371f0af8efe8 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:43.653402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b500cb-e826-4c5e-b06a-371f0af8efe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:43.653715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b500cb-e826-4c5e-b06a-371f0af8efe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:43.655184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b500cb-e826-4c5e-b06a-371f0af8efe8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:43.672435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 306/613] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:43.673594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b500cb-e826-4c5e-b06a-371f0af8efe8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:43.705173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:43.739183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4661-21fb-4b53-94ec-aa0976573846 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:43.784618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2631539-bd83-499d-93a5-591424282222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:43.785647 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2631539-bd83-499d-93a5-591424282222 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:43.785937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2631539-bd83-499d-93a5-591424282222 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:43.786217 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2631539-bd83-499d-93a5-591424282222 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:43.801997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b500cb-e826-4c5e-b06a-371f0af8efe8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:43.807398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2631539-bd83-499d-93a5-591424282222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a2631539-bd83-499d-93a5-591424282222 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:43.823138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:43.824148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:43.824957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:43.831249 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 308/614] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:43.832127 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2631539-bd83-499d-93a5-591424282222 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:43.854937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fba12-4c94-4b19-91d9-f3d2f66d2f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:43.855919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fba12-4c94-4b19-91d9-f3d2f66d2f2d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:43.856211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fba12-4c94-4b19-91d9-f3d2f66d2f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:43.856496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fba12-4c94-4b19-91d9-f3d2f66d2f2d None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:43.857528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fba12-4c94-4b19-91d9-f3d2f66d2f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:43.857842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fba12-4c94-4b19-91d9-f3d2f66d2f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:43.859662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fba12-4c94-4b19-91d9-f3d2f66d2f2d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:43.877946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 307/615] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:43.878809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fba12-4c94-4b19-91d9-f3d2f66d2f2d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:43.921660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:43.959702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2631539-bd83-499d-93a5-591424282222 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:43.998815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2e97-b212-4411-a31a-0a906ad9e213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:44.000559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2e97-b212-4411-a31a-0a906ad9e213 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:44.001023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2e97-b212-4411-a31a-0a906ad9e213 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:44.001717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2e97-b212-4411-a31a-0a906ad9e213 None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2d3018419d0548eda04b3539681f3df5/roles/eda252044624460d8f0580e810d06eda` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:44.005363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:44.013938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fba12-4c94-4b19-91d9-f3d2f66d2f2d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:44.024554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc2e97-b212-4411-a31a-0a906ad9e213 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=2d3018419d0548eda04b3539681f3df5, role_id=eda252044624460d8f0580e810d06eda)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:44.027175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc2e97-b212-4411-a31a-0a906ad9e213 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:44.047127 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 309/616] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:44:43 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2d3018419d0548eda04b3539681f3df5/roles/eda252044624460d8f0580e810d06eda => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:44:44.048315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2e97-b212-4411-a31a-0a906ad9e213 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:44.067104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e5365-78f8-4ce7-bbd6-baa2974636f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:44.067812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e5365-78f8-4ce7-bbd6-baa2974636f3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:44.068101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e5365-78f8-4ce7-bbd6-baa2974636f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:44.068381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e5365-78f8-4ce7-bbd6-baa2974636f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:44.069452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e5365-78f8-4ce7-bbd6-baa2974636f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:44.069452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e5365-78f8-4ce7-bbd6-baa2974636f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:44.071515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e5365-78f8-4ce7-bbd6-baa2974636f3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:44.090581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 308/617] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:44.109015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e5365-78f8-4ce7-bbd6-baa2974636f3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:44.210338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2e97-b212-4411-a31a-0a906ad9e213 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:44.273683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb66ae6-790d-4c38-b6f0-0fb1fb2d2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:44.274954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb66ae6-790d-4c38-b6f0-0fb1fb2d2c27 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:44.275442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb66ae6-790d-4c38-b6f0-0fb1fb2d2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:44.275873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb66ae6-790d-4c38-b6f0-0fb1fb2d2c27 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:44.285563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb66ae6-790d-4c38-b6f0-0fb1fb2d2c27 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:44.287376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb66ae6-790d-4c38-b6f0-0fb1fb2d2c27 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-0cb66ae6-790d-4c38-b6f0-0fb1fb2d2c27 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:44.306716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:44.307908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:44.309053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:44.309053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:44.309053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:44.309053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:44.309053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:44.309053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:44.309053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:44.309053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:44.309053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:44:44.309053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:44.312699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 310/618] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:44:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:44.321983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb66ae6-790d-4c38-b6f0-0fb1fb2d2c27 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:44.348838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:44.358056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e5365-78f8-4ce7-bbd6-baa2974636f3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:44.380817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:44.393746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cc890-abc9-4c02-a8c9-bfa8aed96f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:44.394796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc890-abc9-4c02-a8c9-bfa8aed96f23 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:44.394932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc890-abc9-4c02-a8c9-bfa8aed96f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:44.395301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc890-abc9-4c02-a8c9-bfa8aed96f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:44.408110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cc890-abc9-4c02-a8c9-bfa8aed96f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:44.409703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cc890-abc9-4c02-a8c9-bfa8aed96f23 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-294cc890-abc9-4c02-a8c9-bfa8aed96f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:44.428882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:44.429913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:44.431332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:44.431332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:44.431332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:44.431332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:44.431332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 309/619] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:44.436352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cc890-abc9-4c02-a8c9-bfa8aed96f23 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:44.452256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb66ae6-790d-4c38-b6f0-0fb1fb2d2c27 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:44.491190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459104ef-c120-4a81-af40-b90d927a6a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:44.492355 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459104ef-c120-4a81-af40-b90d927a6a57 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:44.493042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459104ef-c120-4a81-af40-b90d927a6a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:44.493578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459104ef-c120-4a81-af40-b90d927a6a57 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:44.494734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459104ef-c120-4a81-af40-b90d927a6a57 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:44.495319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459104ef-c120-4a81-af40-b90d927a6a57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:44.497140 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459104ef-c120-4a81-af40-b90d927a6a57 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:44.518710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 311/620] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jun 21 15:44:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:44.538349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459104ef-c120-4a81-af40-b90d927a6a57 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:44.563306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cc890-abc9-4c02-a8c9-bfa8aed96f23 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:44.594679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6ff3b-2115-40ed-bc52-a30896640a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:44.594950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6ff3b-2115-40ed-bc52-a30896640a22 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:44.595614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6ff3b-2115-40ed-bc52-a30896640a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:44.602368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6ff3b-2115-40ed-bc52-a30896640a22 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:44.602368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6ff3b-2115-40ed-bc52-a30896640a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:44.602368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6ff3b-2115-40ed-bc52-a30896640a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:44.602368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6ff3b-2115-40ed-bc52-a30896640a22 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:44.619220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 310/621] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:44.620882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6ff3b-2115-40ed-bc52-a30896640a22 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:44.643546 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:44.754261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459104ef-c120-4a81-af40-b90d927a6a57 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:44.755805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:44.808163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a38a5-5913-407e-8427-0e629ad657d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:44.809149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a38a5-5913-407e-8427-0e629ad657d9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:44.809437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a38a5-5913-407e-8427-0e629ad657d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:44.809715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a38a5-5913-407e-8427-0e629ad657d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:44.829756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a38a5-5913-407e-8427-0e629ad657d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:44.831145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a38a5-5913-407e-8427-0e629ad657d9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:44.860687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6ff3b-2115-40ed-bc52-a30896640a22 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-2e4a38a5-5913-407e-8427-0e629ad657d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:44.868590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:44.869451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:44.870746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:44.870746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:44.870746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:44.870746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:44.870746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 312/622] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:44.876459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a38a5-5913-407e-8427-0e629ad657d9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:44.954237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fc3a9-95e5-4a09-8408-acad7e066366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:44.955047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fc3a9-95e5-4a09-8408-acad7e066366 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:44.955355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fc3a9-95e5-4a09-8408-acad7e066366 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:44.955634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fc3a9-95e5-4a09-8408-acad7e066366 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:44.973791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fc3a9-95e5-4a09-8408-acad7e066366 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:44.975299 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fc3a9-95e5-4a09-8408-acad7e066366 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-761fc3a9-95e5-4a09-8408-acad7e066366 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:45.003915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:45.004930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:45.006564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 311/623] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jun 21 15:44:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:45.011394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fc3a9-95e5-4a09-8408-acad7e066366 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:45.088799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a38a5-5913-407e-8427-0e629ad657d9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:45.131549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:45.147112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a28fe4-0183-4f98-9f8e-2c6b157fa743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:45.147980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a28fe4-0183-4f98-9f8e-2c6b157fa743 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.148330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a28fe4-0183-4f98-9f8e-2c6b157fa743 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.148614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a28fe4-0183-4f98-9f8e-2c6b157fa743 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.149349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a28fe4-0183-4f98-9f8e-2c6b157fa743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:45.149658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a28fe4-0183-4f98-9f8e-2c6b157fa743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:45.151045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a28fe4-0183-4f98-9f8e-2c6b157fa743 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:45.165161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 313/624] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:45.166621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb920-cbb5-495e-a327-fbc77f1014f7 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.166919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb920-cbb5-495e-a327-fbc77f1014f7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.171334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb920-cbb5-495e-a327-fbc77f1014f7 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.173188 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 314/625] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:45.174389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbb920-cbb5-495e-a327-fbc77f1014f7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:45.183538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fc3a9-95e5-4a09-8408-acad7e066366 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:45.192343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:45.219501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dfddb-dd8d-44b1-aa6d-17d290f0a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:45.220186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dfddb-dd8d-44b1-aa6d-17d290f0a73b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.220477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dfddb-dd8d-44b1-aa6d-17d290f0a73b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.220769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dfddb-dd8d-44b1-aa6d-17d290f0a73b None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.221627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dfddb-dd8d-44b1-aa6d-17d290f0a73b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:45.221944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dfddb-dd8d-44b1-aa6d-17d290f0a73b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:45.223410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dfddb-dd8d-44b1-aa6d-17d290f0a73b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:45.246948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 312/626] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jun 21 15:44:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:45.248388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0e9f-68d7-4efc-b7cf-20c8a0e5a82e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.248688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0e9f-68d7-4efc-b7cf-20c8a0e5a82e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.248973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0e9f-68d7-4efc-b7cf-20c8a0e5a82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.265767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-308f0e9f-68d7-4efc-b7cf-20c8a0e5a82e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:45.266995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-308f0e9f-68d7-4efc-b7cf-20c8a0e5a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:45.288655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbb920-cbb5-495e-a327-fbc77f1014f7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:45.327895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f963-2e4f-4228-b301-e9e799ee805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:45.328703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f963-2e4f-4228-b301-e9e799ee805e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.328990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f963-2e4f-4228-b301-e9e799ee805e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.329364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f963-2e4f-4228-b301-e9e799ee805e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.337440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2f963-2e4f-4228-b301-e9e799ee805e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:45.338961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2f963-2e4f-4228-b301-e9e799ee805e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:45.343312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 313/627] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:45.344192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f0e9f-68d7-4efc-b7cf-20c8a0e5a82e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b2f2f963-2e4f-4228-b301-e9e799ee805e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:45.369028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:45.371198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:45.373413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:45.373413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:45.373413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:45.373413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:45.373413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:45.373413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:45.373413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:45.373413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:45.373413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 315/628] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:45.376284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f963-2e4f-4228-b301-e9e799ee805e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:45.415885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:45.462414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:45.464438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f0e9f-68d7-4efc-b7cf-20c8a0e5a82e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:45.490732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f963-2e4f-4228-b301-e9e799ee805e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:45.505624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146b564-41b3-47ca-a383-17b66c5cb638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:45.506285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146b564-41b3-47ca-a383-17b66c5cb638 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.506566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146b564-41b3-47ca-a383-17b66c5cb638 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.506849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146b564-41b3-47ca-a383-17b66c5cb638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.532071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780dc0e-9a29-476b-bdb6-555ceaf6dcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:45.533022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780dc0e-9a29-476b-bdb6-555ceaf6dcec None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.533418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780dc0e-9a29-476b-bdb6-555ceaf6dcec None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.533774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780dc0e-9a29-476b-bdb6-555ceaf6dcec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.546072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780dc0e-9a29-476b-bdb6-555ceaf6dcec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-8780dc0e-9a29-476b-bdb6-555ceaf6dcec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:45.555117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:45.556378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:45.557447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:45.558682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 316/629] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:45.559581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780dc0e-9a29-476b-bdb6-555ceaf6dcec None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:45.587454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146b564-41b3-47ca-a383-17b66c5cb638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:45.588919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146b564-41b3-47ca-a383-17b66c5cb638 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:45.650528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:45.680198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780dc0e-9a29-476b-bdb6-555ceaf6dcec None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:45.700435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 314/630] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:45.700435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8745c5a-fc44-47b0-9d87-f3d850239689 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.700435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8745c5a-fc44-47b0-9d87-f3d850239689 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.700435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8745c5a-fc44-47b0-9d87-f3d850239689 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.700435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 315/631] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:45.706090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8745c5a-fc44-47b0-9d87-f3d850239689 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:45.730898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32fe90-91f7-4dae-9ff7-f900958ada7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:45.731838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32fe90-91f7-4dae-9ff7-f900958ada7f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.732129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32fe90-91f7-4dae-9ff7-f900958ada7f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.732413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32fe90-91f7-4dae-9ff7-f900958ada7f None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.733203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32fe90-91f7-4dae-9ff7-f900958ada7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:45.733527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32fe90-91f7-4dae-9ff7-f900958ada7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:45.734973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32fe90-91f7-4dae-9ff7-f900958ada7f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:45.736943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:45.754431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 317/632] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:45.754431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32fe90-91f7-4dae-9ff7-f900958ada7f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:45.826804 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8745c5a-fc44-47b0-9d87-f3d850239689 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:45.860265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32fe90-91f7-4dae-9ff7-f900958ada7f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:45.870216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b9888-e359-48f9-b852-3ef79cf786b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:45.871111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b9888-e359-48f9-b852-3ef79cf786b8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.871576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b9888-e359-48f9-b852-3ef79cf786b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.871854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b9888-e359-48f9-b852-3ef79cf786b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.872609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b9888-e359-48f9-b852-3ef79cf786b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:45.872916 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b9888-e359-48f9-b852-3ef79cf786b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:45.874316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b9888-e359-48f9-b852-3ef79cf786b8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:45.884413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 316/633] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:45.890100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e009e-6175-42df-a83b-ce52c03b97b0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.890393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e009e-6175-42df-a83b-ce52c03b97b0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.890680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e009e-6175-42df-a83b-ce52c03b97b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.901162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075db67-030e-4981-8bec-4c6ff730d7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:45.901890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075db67-030e-4981-8bec-4c6ff730d7ab None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:45.902179 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075db67-030e-4981-8bec-4c6ff730d7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:45.902451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075db67-030e-4981-8bec-4c6ff730d7ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:45.908148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-577e009e-6175-42df-a83b-ce52c03b97b0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:45.909788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-577e009e-6175-42df-a83b-ce52c03b97b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:45.912871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075db67-030e-4981-8bec-4c6ff730d7ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:45.914848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075db67-030e-4981-8bec-4c6ff730d7ab None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:45.923636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-6075db67-030e-4981-8bec-4c6ff730d7ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:45.937307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:45.938196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:45.939090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:45.939090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:45.939090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:45.939090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:45.943301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 318/634] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:45.944218 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075db67-030e-4981-8bec-4c6ff730d7ab None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:45.999195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 317/635] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:45.999195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e009e-6175-42df-a83b-ce52c03b97b0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:46.009611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:46.074090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075db67-030e-4981-8bec-4c6ff730d7ab None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:46.110463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e009e-6175-42df-a83b-ce52c03b97b0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:46.113090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c149c-3c72-4afd-90f2-73bea9a6dab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:46.114004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c149c-3c72-4afd-90f2-73bea9a6dab6 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.114292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c149c-3c72-4afd-90f2-73bea9a6dab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.114576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c149c-3c72-4afd-90f2-73bea9a6dab6 None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/35ec9ea691c141eb86bf7a825fbb80ed/roles/eda252044624460d8f0580e810d06eda` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.130930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c149c-3c72-4afd-90f2-73bea9a6dab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=35ec9ea691c141eb86bf7a825fbb80ed, role_id=eda252044624460d8f0580e810d06eda)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:46.133407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c149c-3c72-4afd-90f2-73bea9a6dab6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:46.147984 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494d675-1efc-4625-935b-6e1aafe08efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:46.150022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d675-1efc-4625-935b-6e1aafe08efb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.155563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d675-1efc-4625-935b-6e1aafe08efb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.155729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 319/636] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:44:45 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/35ec9ea691c141eb86bf7a825fbb80ed/roles/eda252044624460d8f0580e810d06eda => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:44:46.155834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d675-1efc-4625-935b-6e1aafe08efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.155918 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c149c-3c72-4afd-90f2-73bea9a6dab6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:46.162759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494d675-1efc-4625-935b-6e1aafe08efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:46.165175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494d675-1efc-4625-935b-6e1aafe08efb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:46.174142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c494d675-1efc-4625-935b-6e1aafe08efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:46.190237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:46.191410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:46.192515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:46.192515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:46.192515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:46.192515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:46.195934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 318/637] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:46.196997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494d675-1efc-4625-935b-6e1aafe08efb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:46.289300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:46.299376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c149c-3c72-4afd-90f2-73bea9a6dab6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:46.347927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494d675-1efc-4625-935b-6e1aafe08efb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:46.348136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20e5c9-db53-43f7-9d8c-0370058ccbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:46.348546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20e5c9-db53-43f7-9d8c-0370058ccbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.348858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20e5c9-db53-43f7-9d8c-0370058ccbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.349136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20e5c9-db53-43f7-9d8c-0370058ccbb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.349881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20e5c9-db53-43f7-9d8c-0370058ccbb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:46.350170 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20e5c9-db53-43f7-9d8c-0370058ccbb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:46.351684 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20e5c9-db53-43f7-9d8c-0370058ccbb1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:46.365419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 320/638] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:46.365419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20e5c9-db53-43f7-9d8c-0370058ccbb1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:46.400044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877298-928c-4b13-82dd-afb1adc6c60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:46.401385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877298-928c-4b13-82dd-afb1adc6c60d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.401828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877298-928c-4b13-82dd-afb1adc6c60d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.402285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877298-928c-4b13-82dd-afb1adc6c60d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.417666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6877298-928c-4b13-82dd-afb1adc6c60d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c6877298-928c-4b13-82dd-afb1adc6c60d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:46.428024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:46.429145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:46.430655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:46.433682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 319/639] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:46.439534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877298-928c-4b13-82dd-afb1adc6c60d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:46.484167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20e5c9-db53-43f7-9d8c-0370058ccbb1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:46.504174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:46.526480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6581c-1b74-43f8-acde-02fe4963d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:46.527428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6581c-1b74-43f8-acde-02fe4963d99f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.527895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6581c-1b74-43f8-acde-02fe4963d99f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.528339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6581c-1b74-43f8-acde-02fe4963d99f None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.529291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6581c-1b74-43f8-acde-02fe4963d99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:46.529751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6581c-1b74-43f8-acde-02fe4963d99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:46.531427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6581c-1b74-43f8-acde-02fe4963d99f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:46.545765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 321/640] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:46.546934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6581c-1b74-43f8-acde-02fe4963d99f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:46.555636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877298-928c-4b13-82dd-afb1adc6c60d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:46.566933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:46.595773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b28d4f-47ec-4cc9-8921-6b85227f600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:46.596678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28d4f-47ec-4cc9-8921-6b85227f600e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.597024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28d4f-47ec-4cc9-8921-6b85227f600e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.597368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28d4f-47ec-4cc9-8921-6b85227f600e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.605733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b28d4f-47ec-4cc9-8921-6b85227f600e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:46.607342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b28d4f-47ec-4cc9-8921-6b85227f600e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-18b28d4f-47ec-4cc9-8921-6b85227f600e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:46.622782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:46.624028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:46.625139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:46.625139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:46.625139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:46.625139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:46.625139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:46.625139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:46.625139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:46.625139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:46.625795 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 320/641] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:46.626578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b28d4f-47ec-4cc9-8921-6b85227f600e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:46.665402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6581c-1b74-43f8-acde-02fe4963d99f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:46.704776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2de271-dc1b-44c1-a7ef-8d7198d3e368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:46.705366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2de271-dc1b-44c1-a7ef-8d7198d3e368 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.705652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2de271-dc1b-44c1-a7ef-8d7198d3e368 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.706536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2de271-dc1b-44c1-a7ef-8d7198d3e368 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.707335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2de271-dc1b-44c1-a7ef-8d7198d3e368 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:46.707650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2de271-dc1b-44c1-a7ef-8d7198d3e368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:46.709025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2de271-dc1b-44c1-a7ef-8d7198d3e368 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:46.718467 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 322/642] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:46.719821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186ee9c-1986-4315-aa62-70a14b0417c7 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.720118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186ee9c-1986-4315-aa62-70a14b0417c7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.720398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186ee9c-1986-4315-aa62-70a14b0417c7 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.721637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 323/643] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:46.722325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186ee9c-1986-4315-aa62-70a14b0417c7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:46.755795 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b28d4f-47ec-4cc9-8921-6b85227f600e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:46.776730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:46.800305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc398e9-3f93-4135-9268-b3b5a31e3162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:46.801227 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc398e9-3f93-4135-9268-b3b5a31e3162 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.801607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc398e9-3f93-4135-9268-b3b5a31e3162 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.801891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc398e9-3f93-4135-9268-b3b5a31e3162 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.810254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc398e9-3f93-4135-9268-b3b5a31e3162 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:46.812075 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc398e9-3f93-4135-9268-b3b5a31e3162 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:46.826876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ddc398e9-3f93-4135-9268-b3b5a31e3162 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:46.828564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:46.829894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 321/644] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:46.830989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc398e9-3f93-4135-9268-b3b5a31e3162 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:46.861017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186ee9c-1986-4315-aa62-70a14b0417c7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:46.901175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73ceee-9ad2-4bd5-b532-0037723c95aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:46.901995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ceee-9ad2-4bd5-b532-0037723c95aa None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.902386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ceee-9ad2-4bd5-b532-0037723c95aa None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.902791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ceee-9ad2-4bd5-b532-0037723c95aa None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.903757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73ceee-9ad2-4bd5-b532-0037723c95aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:46.904182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73ceee-9ad2-4bd5-b532-0037723c95aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:46.905688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73ceee-9ad2-4bd5-b532-0037723c95aa None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:46.923317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 324/645] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:46.924874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd51b1-cdcf-4c15-8762-4b6077d3234b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.925268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd51b1-cdcf-4c15-8762-4b6077d3234b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.925663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd51b1-cdcf-4c15-8762-4b6077d3234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:46.946768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-33fd51b1-cdcf-4c15-8762-4b6077d3234b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:46.948672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-33fd51b1-cdcf-4c15-8762-4b6077d3234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:46.951512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc398e9-3f93-4135-9268-b3b5a31e3162 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:46.996369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4246236-7a57-4362-a2f3-02b1c579fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:46.997239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4246236-7a57-4362-a2f3-02b1c579fb29 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:46.997625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4246236-7a57-4362-a2f3-02b1c579fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:46.997974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4246236-7a57-4362-a2f3-02b1c579fb29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:47.010146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4246236-7a57-4362-a2f3-02b1c579fb29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:47.011785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4246236-7a57-4362-a2f3-02b1c579fb29 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c4246236-7a57-4362-a2f3-02b1c579fb29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:47.030811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:47.031946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:47.040503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:47.040503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:47.040503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:47.040503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:47.040723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 325/646] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:47.040723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd51b1-cdcf-4c15-8762-4b6077d3234b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:47.040862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 322/647] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:47.040862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4246236-7a57-4362-a2f3-02b1c579fb29 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:47.080450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:47.116988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:47.154228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd51b1-cdcf-4c15-8762-4b6077d3234b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:47.161338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4246236-7a57-4362-a2f3-02b1c579fb29 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:47.192014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e74df-301d-4dc3-a421-df12897c57fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:47.192818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e74df-301d-4dc3-a421-df12897c57fa None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:47.193190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e74df-301d-4dc3-a421-df12897c57fa None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:47.193543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e74df-301d-4dc3-a421-df12897c57fa None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:47.194456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e74df-301d-4dc3-a421-df12897c57fa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:47.194867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e74df-301d-4dc3-a421-df12897c57fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:47.196475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e74df-301d-4dc3-a421-df12897c57fa None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:47.199037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f572a4-b927-4a61-a017-282eaee6e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:47.199890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f572a4-b927-4a61-a017-282eaee6e416 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:47.200184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f572a4-b927-4a61-a017-282eaee6e416 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:47.200467 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f572a4-b927-4a61-a017-282eaee6e416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:47.201306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f572a4-b927-4a61-a017-282eaee6e416 None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2ab989a935eb4d91a94611cededd3cf6) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:47.201627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f572a4-b927-4a61-a017-282eaee6e416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:47.203059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f572a4-b927-4a61-a017-282eaee6e416 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:47.210041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 323/648] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:47 2022] GET /identity/v3/role_assignments?user.id=2ab989a935eb4d91a94611cededd3cf6&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:47.211673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f572a4-b927-4a61-a017-282eaee6e416 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:47.231088 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 326/649] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jun 21 15:44:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:47.232393 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e74df-301d-4dc3-a421-df12897c57fa None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:47.347154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:47.355656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f572a4-b927-4a61-a017-282eaee6e416 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:47.404579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5649b6-b044-4954-b07f-f68d778fc9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:47.405595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5649b6-b044-4954-b07f-f68d778fc9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:47.405885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5649b6-b044-4954-b07f-f68d778fc9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:47.406172 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5649b6-b044-4954-b07f-f68d778fc9c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:47.409926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5649b6-b044-4954-b07f-f68d778fc9c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:47.409926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5649b6-b044-4954-b07f-f68d778fc9c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:47.409926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5649b6-b044-4954-b07f-f68d778fc9c1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:47.415444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e74df-301d-4dc3-a421-df12897c57fa None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:47.425500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 324/650] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:47.426351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5649b6-b044-4954-b07f-f68d778fc9c1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:47.457189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:47.471609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1498a-8465-40bf-9af2-e68795d93ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:47.472477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1498a-8465-40bf-9af2-e68795d93ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:47.472753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1498a-8465-40bf-9af2-e68795d93ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:47.473217 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1498a-8465-40bf-9af2-e68795d93ed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:47.498288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1498a-8465-40bf-9af2-e68795d93ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9eb1498a-8465-40bf-9af2-e68795d93ed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:47.512267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:47.513802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:47.515992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:47.518173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 327/651] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:47.518173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1498a-8465-40bf-9af2-e68795d93ed1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:47.587100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5649b6-b044-4954-b07f-f68d778fc9c1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:47.644423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5c71-a40c-4a9e-8d3b-090737193d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:47.645007 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5c71-a40c-4a9e-8d3b-090737193d26 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:47.646044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5c71-a40c-4a9e-8d3b-090737193d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:47.646593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5c71-a40c-4a9e-8d3b-090737193d26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:47.654925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1498a-8465-40bf-9af2-e68795d93ed1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:47.676182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:47.719566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9dea0-be64-481e-a583-80d89f22d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:47.721151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9dea0-be64-481e-a583-80d89f22d2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:47.721733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9dea0-be64-481e-a583-80d89f22d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:47.722101 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9dea0-be64-481e-a583-80d89f22d2a1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:47.736431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9dea0-be64-481e-a583-80d89f22d2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:47.738180 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9dea0-be64-481e-a583-80d89f22d2a1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:47.740946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f5c71-a40c-4a9e-8d3b-090737193d26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:47.743914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f5c71-a40c-4a9e-8d3b-090737193d26 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-02b9dea0-be64-481e-a583-80d89f22d2a1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:47.764751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:47.765824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:47.766947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:47.766947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:47.766947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:47.766947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:47.766947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:47.766947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:47.766947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:47.766947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:47.766947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:44:47.766947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:47.767670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 328/652] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:47.768302 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9dea0-be64-481e-a583-80d89f22d2a1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:47.830997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:47.905663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 325/653] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:47.906583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5c71-a40c-4a9e-8d3b-090737193d26 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:47.917937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9dea0-be64-481e-a583-80d89f22d2a1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:47.981559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37761e4-9920-4f89-bfa7-738ce588c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:47.982414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37761e4-9920-4f89-bfa7-738ce588c62d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:47.982537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37761e4-9920-4f89-bfa7-738ce588c62d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:47.982790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37761e4-9920-4f89-bfa7-738ce588c62d None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:47.983599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37761e4-9920-4f89-bfa7-738ce588c62d None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:47.983916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37761e4-9920-4f89-bfa7-738ce588c62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:47.985450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37761e4-9920-4f89-bfa7-738ce588c62d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:47.999424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:48.001780 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 329/654] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:48.003503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37761e4-9920-4f89-bfa7-738ce588c62d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:48.058714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5c71-a40c-4a9e-8d3b-090737193d26 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:48.116148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe034f91-9bfb-44f2-8bd0-58fc93832f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:48.118316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe034f91-9bfb-44f2-8bd0-58fc93832f4a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:48.118316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe034f91-9bfb-44f2-8bd0-58fc93832f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:48.118621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe034f91-9bfb-44f2-8bd0-58fc93832f4a None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:48.119541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe034f91-9bfb-44f2-8bd0-58fc93832f4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:48.119858 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe034f91-9bfb-44f2-8bd0-58fc93832f4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:48.121346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe034f91-9bfb-44f2-8bd0-58fc93832f4a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:48.142365 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 326/655] 10.222.0.46 () {56 vars in 1137 bytes} [Tue Jun 21 15:44:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:48.143401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe034f91-9bfb-44f2-8bd0-58fc93832f4a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:48.149468 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37761e4-9920-4f89-bfa7-738ce588c62d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:48.159852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:48.191154 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2495bc-059c-4eaf-9591-a8d7641a114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:48.192427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2495bc-059c-4eaf-9591-a8d7641a114d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:48.192942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2495bc-059c-4eaf-9591-a8d7641a114d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:48.193444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2495bc-059c-4eaf-9591-a8d7641a114d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:48.206144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2495bc-059c-4eaf-9591-a8d7641a114d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:48.208095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2495bc-059c-4eaf-9591-a8d7641a114d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-ea2495bc-059c-4eaf-9591-a8d7641a114d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:48.228709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:48.229656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:48.230548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:48.230548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:48.230548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:48.230548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:48.237019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 330/656] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:48.238111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2495bc-059c-4eaf-9591-a8d7641a114d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:48.253253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe034f91-9bfb-44f2-8bd0-58fc93832f4a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:48.267498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:48.291355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c11da-9413-4de7-9c39-3b76808050c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:48.292262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c11da-9413-4de7-9c39-3b76808050c1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:48.292562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c11da-9413-4de7-9c39-3b76808050c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:48.292848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c11da-9413-4de7-9c39-3b76808050c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:48.307932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c11da-9413-4de7-9c39-3b76808050c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:48.309614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c11da-9413-4de7-9c39-3b76808050c1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8d4c11da-9413-4de7-9c39-3b76808050c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:48.328778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:48.329913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:48.330808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:48.330808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:48.330808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:48.330808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:48.334776 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 327/657] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:48.335866 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c11da-9413-4de7-9c39-3b76808050c1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:48.353065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2495bc-059c-4eaf-9591-a8d7641a114d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:48.390634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7220b-404e-4066-818f-935dc994424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:48.391430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7220b-404e-4066-818f-935dc994424b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:48.391793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7220b-404e-4066-818f-935dc994424b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:48.392146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7220b-404e-4066-818f-935dc994424b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:48.425646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:48.451672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c11da-9413-4de7-9c39-3b76808050c1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:48.471897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7220b-404e-4066-818f-935dc994424b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:48.473479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7220b-404e-4066-818f-935dc994424b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:48.515222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78ca6-71e0-4d6e-b6d9-211b2b8468cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:48.516338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78ca6-71e0-4d6e-b6d9-211b2b8468cf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:48.516867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78ca6-71e0-4d6e-b6d9-211b2b8468cf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:48.517578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78ca6-71e0-4d6e-b6d9-211b2b8468cf None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:48.519784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78ca6-71e0-4d6e-b6d9-211b2b8468cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:48.520554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78ca6-71e0-4d6e-b6d9-211b2b8468cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:48.524784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78ca6-71e0-4d6e-b6d9-211b2b8468cf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:48.552227 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 328/658] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:48.552227 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78ca6-71e0-4d6e-b6d9-211b2b8468cf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:48.582694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:48.591616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 331/659] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:48.593556 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032862aa-6712-465e-89f2-4d80fd6cec0c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:48.593906 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032862aa-6712-465e-89f2-4d80fd6cec0c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:48.594133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032862aa-6712-465e-89f2-4d80fd6cec0c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:48.599209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 332/660] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:48.599209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032862aa-6712-465e-89f2-4d80fd6cec0c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:48.672040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:48.681532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78ca6-71e0-4d6e-b6d9-211b2b8468cf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:48.717967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e930a-0256-4b50-9202-097fc54ac176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:48.718632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e930a-0256-4b50-9202-097fc54ac176 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:48.718922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e930a-0256-4b50-9202-097fc54ac176 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:48.719228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e930a-0256-4b50-9202-097fc54ac176 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:48.719952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e930a-0256-4b50-9202-097fc54ac176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:48.720259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e930a-0256-4b50-9202-097fc54ac176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:48.721630 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e930a-0256-4b50-9202-097fc54ac176 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:48.725139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032862aa-6712-465e-89f2-4d80fd6cec0c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:48.739320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 329/661] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:48.740467 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e930a-0256-4b50-9202-097fc54ac176 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:48.766384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4ec56-9de2-4f2d-a2f5-89a0226f8336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:48.767200 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ec56-9de2-4f2d-a2f5-89a0226f8336 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:48.767495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ec56-9de2-4f2d-a2f5-89a0226f8336 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:48.767778 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ec56-9de2-4f2d-a2f5-89a0226f8336 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:48.774818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4ec56-9de2-4f2d-a2f5-89a0226f8336 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:48.776422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4ec56-9de2-4f2d-a2f5-89a0226f8336 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e7b4ec56-9de2-4f2d-a2f5-89a0226f8336 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:48.790538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:48.791536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:48.792442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:48.792442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:48.792442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:48.792442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:48.792442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:48.792442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:48.792442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:48.792442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:48.792442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 333/662] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:48.793591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469d194-ed4e-43df-b57a-efbe41a493e1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:48.793591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469d194-ed4e-43df-b57a-efbe41a493e1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:48.793591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469d194-ed4e-43df-b57a-efbe41a493e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:48.811195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7469d194-ed4e-43df-b57a-efbe41a493e1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:48.812658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7469d194-ed4e-43df-b57a-efbe41a493e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:48.843290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:48.862263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e930a-0256-4b50-9202-097fc54ac176 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:48.897110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 334/663] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:48.898011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469d194-ed4e-43df-b57a-efbe41a493e1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:48.907435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cc283-4d10-4db9-9cc4-f3ec01dcf839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:48.908756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc283-4d10-4db9-9cc4-f3ec01dcf839 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:48.909256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc283-4d10-4db9-9cc4-f3ec01dcf839 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:48.909800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc283-4d10-4db9-9cc4-f3ec01dcf839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:48.922996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cc283-4d10-4db9-9cc4-f3ec01dcf839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:48.924887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cc283-4d10-4db9-9cc4-f3ec01dcf839 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8d3cc283-4d10-4db9-9cc4-f3ec01dcf839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:48.946166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:48.947136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:48.949278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:48.949278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:48.949278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:48.949278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:48.949278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 330/664] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:48.949278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cc283-4d10-4db9-9cc4-f3ec01dcf839 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:48.967613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:49.029233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469d194-ed4e-43df-b57a-efbe41a493e1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:49.064992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cc283-4d10-4db9-9cc4-f3ec01dcf839 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:49.066698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8ee8-d0e8-4331-bfc9-2c1e96ace68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:49.067532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8ee8-d0e8-4331-bfc9-2c1e96ace68b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:49.067815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8ee8-d0e8-4331-bfc9-2c1e96ace68b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:49.068090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8ee8-d0e8-4331-bfc9-2c1e96ace68b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:49.075446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d8ee8-d0e8-4331-bfc9-2c1e96ace68b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:49.076903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d8ee8-d0e8-4331-bfc9-2c1e96ace68b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-d64d8ee8-d0e8-4331-bfc9-2c1e96ace68b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:49.092131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:49.093094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:49.094048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 335/665] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:49.094652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8ee8-d0e8-4331-bfc9-2c1e96ace68b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:49.108724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838970f-025e-4c33-9bd6-fc893fc97e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:49.109391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838970f-025e-4c33-9bd6-fc893fc97e28 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:49.109687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838970f-025e-4c33-9bd6-fc893fc97e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:49.109956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838970f-025e-4c33-9bd6-fc893fc97e28 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:49.110750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838970f-025e-4c33-9bd6-fc893fc97e28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:49.111062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838970f-025e-4c33-9bd6-fc893fc97e28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:49.112528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838970f-025e-4c33-9bd6-fc893fc97e28 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:49.115010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:49.127201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 331/666] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:49.127201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838970f-025e-4c33-9bd6-fc893fc97e28 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:49.216525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8ee8-d0e8-4331-bfc9-2c1e96ace68b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:49.230227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:49.239076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838970f-025e-4c33-9bd6-fc893fc97e28 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:49.257101 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f152ca-78ba-4254-84e1-09ff2634f70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:49.258481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f152ca-78ba-4254-84e1-09ff2634f70d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:49.258768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f152ca-78ba-4254-84e1-09ff2634f70d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:49.259043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f152ca-78ba-4254-84e1-09ff2634f70d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:49.270904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f152ca-78ba-4254-84e1-09ff2634f70d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:49.274763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15cc2d-e5a4-4906-9154-ab3552568aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:49.275455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15cc2d-e5a4-4906-9154-ab3552568aed None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:49.275745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15cc2d-e5a4-4906-9154-ab3552568aed None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:49.276026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15cc2d-e5a4-4906-9154-ab3552568aed None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:49.276754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15cc2d-e5a4-4906-9154-ab3552568aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:49.277059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15cc2d-e5a4-4906-9154-ab3552568aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:49.278419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15cc2d-e5a4-4906-9154-ab3552568aed None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-29f152ca-78ba-4254-84e1-09ff2634f70d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:49.279496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:49.280404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:49.281253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:49.281881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 336/667] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:49.287210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f152ca-78ba-4254-84e1-09ff2634f70d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:49.291723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 332/668] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:49.292572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15cc2d-e5a4-4906-9154-ab3552568aed None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:49.358719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:49.410708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f152ca-78ba-4254-84e1-09ff2634f70d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:49.417073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15cc2d-e5a4-4906-9154-ab3552568aed None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:49.452813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47315b8-48c5-44ea-b650-fcda3257f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:49.453502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47315b8-48c5-44ea-b650-fcda3257f790 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:49.453795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47315b8-48c5-44ea-b650-fcda3257f790 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:49.454080 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47315b8-48c5-44ea-b650-fcda3257f790 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:49.454937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47315b8-48c5-44ea-b650-fcda3257f790 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:49.455285 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47315b8-48c5-44ea-b650-fcda3257f790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:49.456741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47315b8-48c5-44ea-b650-fcda3257f790 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:49.458092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3afb4-4a3a-4df8-87f0-efb52bf032e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:49.458759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3afb4-4a3a-4df8-87f0-efb52bf032e3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:49.459136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3afb4-4a3a-4df8-87f0-efb52bf032e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:49.459361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3afb4-4a3a-4df8-87f0-efb52bf032e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:49.460219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3afb4-4a3a-4df8-87f0-efb52bf032e3 None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=6087f9fd3f814573a243f983faf0ce5b) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:49.460545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3afb4-4a3a-4df8-87f0-efb52bf032e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:49.462139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3afb4-4a3a-4df8-87f0-efb52bf032e3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:49.475310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 333/669] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:49 2022] GET /identity/v3/role_assignments?user.id=6087f9fd3f814573a243f983faf0ce5b&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:49.475310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3afb4-4a3a-4df8-87f0-efb52bf032e3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:49.487833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 337/670] 10.222.0.46 () {56 vars in 1139 bytes} [Tue Jun 21 15:44:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:49.488546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47315b8-48c5-44ea-b650-fcda3257f790 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:49.525418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:49.613002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3afb4-4a3a-4df8-87f0-efb52bf032e3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:49.640213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:49.650877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47315b8-48c5-44ea-b650-fcda3257f790 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:49.658203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2ccb1-c83f-4d0c-8419-193fd205ebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:49.658896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2ccb1-c83f-4d0c-8419-193fd205ebf9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:49.659202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2ccb1-c83f-4d0c-8419-193fd205ebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:49.659491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2ccb1-c83f-4d0c-8419-193fd205ebf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:49.660261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2ccb1-c83f-4d0c-8419-193fd205ebf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:49.660575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2ccb1-c83f-4d0c-8419-193fd205ebf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:49.662397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2ccb1-c83f-4d0c-8419-193fd205ebf9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:49.677242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 334/671] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:49.678228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2ccb1-c83f-4d0c-8419-193fd205ebf9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:49.699530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f04a-f008-4b19-afae-d6d2b58385a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:49.700855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f04a-f008-4b19-afae-d6d2b58385a6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:49.701432 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f04a-f008-4b19-afae-d6d2b58385a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:49.701897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070f04a-f008-4b19-afae-d6d2b58385a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:49.713406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070f04a-f008-4b19-afae-d6d2b58385a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:49.714924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070f04a-f008-4b19-afae-d6d2b58385a6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e070f04a-f008-4b19-afae-d6d2b58385a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:49.731530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:49.732446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:49.733401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:49.733401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:49.733401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:49.733401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:49.733401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:49.733401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:49.733401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:49.733401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:49.737374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 338/672] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:49.738260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f04a-f008-4b19-afae-d6d2b58385a6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:49.826266 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2ccb1-c83f-4d0c-8419-193fd205ebf9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:49.859125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:49.874369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070f04a-f008-4b19-afae-d6d2b58385a6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:49.880698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf9490-e2e9-4412-84ba-232f2553565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:49.881368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9490-e2e9-4412-84ba-232f2553565e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:49.881660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9490-e2e9-4412-84ba-232f2553565e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:49.881944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9490-e2e9-4412-84ba-232f2553565e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:49.938726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e19a62-f51b-40b2-9fee-84ada1e8b5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:49.942036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e19a62-f51b-40b2-9fee-84ada1e8b5cd None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:49.942331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e19a62-f51b-40b2-9fee-84ada1e8b5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:49.942616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e19a62-f51b-40b2-9fee-84ada1e8b5cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:49.954031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:49.957151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e19a62-f51b-40b2-9fee-84ada1e8b5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:49.958782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e19a62-f51b-40b2-9fee-84ada1e8b5cd None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f6e19a62-f51b-40b2-9fee-84ada1e8b5cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:49.978967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:49.979951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:49.980836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:49.980836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:49.980836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:49.980836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:49.982940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf9490-e2e9-4412-84ba-232f2553565e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:49.984637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf9490-e2e9-4412-84ba-232f2553565e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:49.986236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 339/673] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:49.987307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e19a62-f51b-40b2-9fee-84ada1e8b5cd None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:50.110482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e19a62-f51b-40b2-9fee-84ada1e8b5cd None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:50.113122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 335/674] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:50.114749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf9490-e2e9-4412-84ba-232f2553565e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:50.160259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d67b78-3600-456b-a41c-86c3ba5f9b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:50.161746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67b78-3600-456b-a41c-86c3ba5f9b8e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:50.162035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67b78-3600-456b-a41c-86c3ba5f9b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:50.162315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67b78-3600-456b-a41c-86c3ba5f9b8e None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:50.163118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d67b78-3600-456b-a41c-86c3ba5f9b8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:50.163460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d67b78-3600-456b-a41c-86c3ba5f9b8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:50.165625 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d67b78-3600-456b-a41c-86c3ba5f9b8e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:50.177821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:50.188597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 340/675] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:50.190025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b77060-719a-4c4b-87cf-ae5b85864760 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:50.190656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b77060-719a-4c4b-87cf-ae5b85864760 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:50.190656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b77060-719a-4c4b-87cf-ae5b85864760 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:50.192037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 341/676] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:50.192758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b77060-719a-4c4b-87cf-ae5b85864760 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:50.231995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:50.257165 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf9490-e2e9-4412-84ba-232f2553565e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:50.301151 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63061e36-a9c3-42c5-b4be-721e1b064770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:50.301889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63061e36-a9c3-42c5-b4be-721e1b064770 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:50.302180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63061e36-a9c3-42c5-b4be-721e1b064770 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:50.302457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63061e36-a9c3-42c5-b4be-721e1b064770 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:50.303211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63061e36-a9c3-42c5-b4be-721e1b064770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:50.303527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63061e36-a9c3-42c5-b4be-721e1b064770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:50.304927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63061e36-a9c3-42c5-b4be-721e1b064770 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:50.308290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b77060-719a-4c4b-87cf-ae5b85864760 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:50.321366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 336/677] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:50.321366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63061e36-a9c3-42c5-b4be-721e1b064770 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:50.350092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7aede8-2a40-4279-8eae-e4c390f70849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:50.350896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aede8-2a40-4279-8eae-e4c390f70849 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:50.351978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aede8-2a40-4279-8eae-e4c390f70849 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:50.352367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aede8-2a40-4279-8eae-e4c390f70849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:50.363043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7aede8-2a40-4279-8eae-e4c390f70849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:50.364609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7aede8-2a40-4279-8eae-e4c390f70849 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-5b7aede8-2a40-4279-8eae-e4c390f70849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:50.384291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:50.385227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:50.386104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:50.386104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:50.386104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:50.386104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:50.386104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 342/678] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:50.387055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648297cd-235a-4139-bbd8-02007fd98c06 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:50.387384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648297cd-235a-4139-bbd8-02007fd98c06 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:50.387665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648297cd-235a-4139-bbd8-02007fd98c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:50.405930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-648297cd-235a-4139-bbd8-02007fd98c06 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:50.407289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-648297cd-235a-4139-bbd8-02007fd98c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:50.434834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63061e36-a9c3-42c5-b4be-721e1b064770 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:50.459454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:50.472847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b467c-1ad8-4c9e-a16a-1024ef6ca685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:50.473510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b467c-1ad8-4c9e-a16a-1024ef6ca685 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:50.473808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b467c-1ad8-4c9e-a16a-1024ef6ca685 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:50.474091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b467c-1ad8-4c9e-a16a-1024ef6ca685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:50.474952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b467c-1ad8-4c9e-a16a-1024ef6ca685 None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=61565364dbac41cfac76195c0be88771) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:50.475301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b467c-1ad8-4c9e-a16a-1024ef6ca685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:50.477272 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b467c-1ad8-4c9e-a16a-1024ef6ca685 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:50.482809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 343/679] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:50.483680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648297cd-235a-4139-bbd8-02007fd98c06 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:50.495190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 337/680] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:50 2022] GET /identity/v3/role_assignments?user.id=61565364dbac41cfac76195c0be88771&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:50.495190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b467c-1ad8-4c9e-a16a-1024ef6ca685 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:50.512445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:50.634069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b467c-1ad8-4c9e-a16a-1024ef6ca685 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:50.649855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648297cd-235a-4139-bbd8-02007fd98c06 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:50.676421 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9d9a1-e904-46db-bf49-7d3df94d57a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:50.677103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9d9a1-e904-46db-bf49-7d3df94d57a7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:50.677395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9d9a1-e904-46db-bf49-7d3df94d57a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:50.677682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9d9a1-e904-46db-bf49-7d3df94d57a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:50.678417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9d9a1-e904-46db-bf49-7d3df94d57a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:50.678732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9d9a1-e904-46db-bf49-7d3df94d57a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:50.682348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9d9a1-e904-46db-bf49-7d3df94d57a7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:50.691487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80127212-47bf-45a8-8f83-68c107b07964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:50.692300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80127212-47bf-45a8-8f83-68c107b07964 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:50.692592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80127212-47bf-45a8-8f83-68c107b07964 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:50.692875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80127212-47bf-45a8-8f83-68c107b07964 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:50.702466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80127212-47bf-45a8-8f83-68c107b07964 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:50.702671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 338/681] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:50.702906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9d9a1-e904-46db-bf49-7d3df94d57a7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:50.704203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80127212-47bf-45a8-8f83-68c107b07964 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-80127212-47bf-45a8-8f83-68c107b07964 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:50.720561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:50.721547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:50.722493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:50.722493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:50.722493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:50.722493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:50.722493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:50.722493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:50.722493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:50.722493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:50.722493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:44:50.722493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:50.723037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 344/682] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:44:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:50.723690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80127212-47bf-45a8-8f83-68c107b07964 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:50.785410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:50.794028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:50.831265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9d9a1-e904-46db-bf49-7d3df94d57a7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:50.859144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80127212-47bf-45a8-8f83-68c107b07964 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:50.872640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2ce2-f4dc-4d8c-876f-0c69af80fdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:50.873739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2ce2-f4dc-4d8c-876f-0c69af80fdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:50.874236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2ce2-f4dc-4d8c-876f-0c69af80fdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:50.874699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2ce2-f4dc-4d8c-876f-0c69af80fdf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:50.886825 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c2ce2-f4dc-4d8c-876f-0c69af80fdf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1c2c2ce2-f4dc-4d8c-876f-0c69af80fdf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:50.895251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:50.896181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:50.897024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:50.898478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02159e-4f44-4326-b675-7c715395d88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:50.899339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02159e-4f44-4326-b675-7c715395d88f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:50.899631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02159e-4f44-4326-b675-7c715395d88f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:50.899910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02159e-4f44-4326-b675-7c715395d88f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:50.900693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 339/683] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:44:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:50.901701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2ce2-f4dc-4d8c-876f-0c69af80fdf6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:50.907547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02159e-4f44-4326-b675-7c715395d88f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:50.909017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02159e-4f44-4326-b675-7c715395d88f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-cf02159e-4f44-4326-b675-7c715395d88f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:50.923479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:50.924419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:50.925311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:50.925311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:50.925311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:50.925311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:50.925311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:50.925311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:50.925311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:50.925311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:50.932973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 345/684] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:50.932973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02159e-4f44-4326-b675-7c715395d88f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:51.037302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2ce2-f4dc-4d8c-876f-0c69af80fdf6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:51.042322 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02159e-4f44-4326-b675-7c715395d88f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:51.043840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:51.067901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:51.076183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88507953-85a5-434c-b738-bfb1051b3920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:51.077152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88507953-85a5-434c-b738-bfb1051b3920 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:51.077648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88507953-85a5-434c-b738-bfb1051b3920 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:51.078128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88507953-85a5-434c-b738-bfb1051b3920 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:51.079202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88507953-85a5-434c-b738-bfb1051b3920 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:51.079430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1b8a3-af16-4cb2-9e39-4aecd945b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:51.080001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88507953-85a5-434c-b738-bfb1051b3920 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:51.080107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b8a3-af16-4cb2-9e39-4aecd945b177 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:51.080372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b8a3-af16-4cb2-9e39-4aecd945b177 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:51.080659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b8a3-af16-4cb2-9e39-4aecd945b177 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:51.081560 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1b8a3-af16-4cb2-9e39-4aecd945b177 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:51.081871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1b8a3-af16-4cb2-9e39-4aecd945b177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:51.082601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88507953-85a5-434c-b738-bfb1051b3920 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:51.083244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1b8a3-af16-4cb2-9e39-4aecd945b177 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:51.096711 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 346/685] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:51.098111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1b8a3-af16-4cb2-9e39-4aecd945b177 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:51.101991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 340/686] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jun 21 15:44:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:51.103058 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88507953-85a5-434c-b738-bfb1051b3920 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:51.210094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88507953-85a5-434c-b738-bfb1051b3920 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:51.222626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1b8a3-af16-4cb2-9e39-4aecd945b177 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:51.247750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f86ec-c481-4d2c-b8f2-8dd513b209f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:51.248739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f86ec-c481-4d2c-b8f2-8dd513b209f3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:51.248993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f86ec-c481-4d2c-b8f2-8dd513b209f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:51.249278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f86ec-c481-4d2c-b8f2-8dd513b209f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:51.260968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f86ec-c481-4d2c-b8f2-8dd513b209f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:51.261952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf6d5-0244-45a8-ae09-1c852878bac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:51.262431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f86ec-c481-4d2c-b8f2-8dd513b209f3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:51.263093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf6d5-0244-45a8-ae09-1c852878bac7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:51.263862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf6d5-0244-45a8-ae09-1c852878bac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:51.264387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bf6d5-0244-45a8-ae09-1c852878bac7 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:51.265384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf6d5-0244-45a8-ae09-1c852878bac7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:51.265891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf6d5-0244-45a8-ae09-1c852878bac7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:51.267613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bf6d5-0244-45a8-ae09-1c852878bac7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-553f86ec-c481-4d2c-b8f2-8dd513b209f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:51.286333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:51.287364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:51.289317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:51.289317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:51.289317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:51.289317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:51.289317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 341/688] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:51.289773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f86ec-c481-4d2c-b8f2-8dd513b209f3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:51.290179 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 347/688] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:51.291370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf6d5-0244-45a8-ae09-1c852878bac7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:51.318220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:51.328928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:51.402231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bf6d5-0244-45a8-ae09-1c852878bac7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:51.403343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f86ec-c481-4d2c-b8f2-8dd513b209f3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:51.440997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b16a7-0f3c-401e-a732-b0dee257bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:51.441210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651b212-bd65-41ce-bd59-b9a4a8f52f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:51.441693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b212-bd65-41ce-bd59-b9a4a8f52f4d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:51.441984 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b212-bd65-41ce-bd59-b9a4a8f52f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:51.442327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651b212-bd65-41ce-bd59-b9a4a8f52f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:51.442796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b16a7-0f3c-401e-a732-b0dee257bd9d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:51.443371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b16a7-0f3c-401e-a732-b0dee257bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:51.443874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b16a7-0f3c-401e-a732-b0dee257bd9d None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:51.444809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b16a7-0f3c-401e-a732-b0dee257bd9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:51.445301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b16a7-0f3c-401e-a732-b0dee257bd9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:51.446987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b16a7-0f3c-401e-a732-b0dee257bd9d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:51.459905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 348/689] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:51.461364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b16a7-0f3c-401e-a732-b0dee257bd9d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:51.521331 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651b212-bd65-41ce-bd59-b9a4a8f52f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:51.522997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651b212-bd65-41ce-bd59-b9a4a8f52f4d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:51.552869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:51.561735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:51.572574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b16a7-0f3c-401e-a732-b0dee257bd9d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:51.607960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1a7b-5969-4666-8e27-831f7782bbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:51.608754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1a7b-5969-4666-8e27-831f7782bbce None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:51.609114 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1a7b-5969-4666-8e27-831f7782bbce None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:51.609756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1a7b-5969-4666-8e27-831f7782bbce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:51.610373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca1a7b-5969-4666-8e27-831f7782bbce None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2d3018419d0548eda04b3539681f3df5) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:51.610757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca1a7b-5969-4666-8e27-831f7782bbce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:51.612304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca1a7b-5969-4666-8e27-831f7782bbce None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:51.627328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 349/690] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:51 2022] GET /identity/v3/role_assignments?user.id=2d3018419d0548eda04b3539681f3df5&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:51.628481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1a7b-5969-4666-8e27-831f7782bbce None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:51.638287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 342/691] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:51.646829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651b212-bd65-41ce-bd59-b9a4a8f52f4d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:51.812996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1a7b-5969-4666-8e27-831f7782bbce None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:51.813789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651b212-bd65-41ce-bd59-b9a4a8f52f4d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:51.858508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee430d22-f990-4d58-98c7-8835119eca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:51.859151 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097fc50-1ec0-4bb1-915f-4426487b69de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:51.859975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee430d22-f990-4d58-98c7-8835119eca4e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:51.860088 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097fc50-1ec0-4bb1-915f-4426487b69de None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:51.860267 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097fc50-1ec0-4bb1-915f-4426487b69de None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:51.860553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097fc50-1ec0-4bb1-915f-4426487b69de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:51.861040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee430d22-f990-4d58-98c7-8835119eca4e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:51.861520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee430d22-f990-4d58-98c7-8835119eca4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:51.863454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:51.874265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097fc50-1ec0-4bb1-915f-4426487b69de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:51.875005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097fc50-1ec0-4bb1-915f-4426487b69de None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:51.876559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee430d22-f990-4d58-98c7-8835119eca4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:51.878166 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee430d22-f990-4d58-98c7-8835119eca4e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-ee430d22-f990-4d58-98c7-8835119eca4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:51.896115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:51.897100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:51.898610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:51.898610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:51.898610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:51.898610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:51.898610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:51.898610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:51.898610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:51.898610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:51.898610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:44:51.898610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3097fc50-1ec0-4bb1-915f-4426487b69de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:51.899238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:51.901245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:51.903381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:51.903381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:51.903381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:51.903381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:51.903381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 343/692] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:51.904143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 350/693] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jun 21 15:44:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:51.904282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf4c51-c573-47a0-8775-f0f37c19ea90 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:51.904282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf4c51-c573-47a0-8775-f0f37c19ea90 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:51.904282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf4c51-c573-47a0-8775-f0f37c19ea90 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:51.904282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 344/694] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:51.906412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee430d22-f990-4d58-98c7-8835119eca4e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:51.907494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf4c51-c573-47a0-8775-f0f37c19ea90 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:51.919896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:52.039401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf4c51-c573-47a0-8775-f0f37c19ea90 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:52.040153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee430d22-f990-4d58-98c7-8835119eca4e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:52.078469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa63ee-c38a-4cb1-8636-64a7714cdfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:52.079069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa63ee-c38a-4cb1-8636-64a7714cdfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.079387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa63ee-c38a-4cb1-8636-64a7714cdfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.079669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa63ee-c38a-4cb1-8636-64a7714cdfe7 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.080515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa63ee-c38a-4cb1-8636-64a7714cdfe7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:52.080828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa63ee-c38a-4cb1-8636-64a7714cdfe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:52.082268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa63ee-c38a-4cb1-8636-64a7714cdfe7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:52.088248 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32641c72-da31-47b6-a79c-e4e706a01b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:52.089225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32641c72-da31-47b6-a79c-e4e706a01b7c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.089711 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32641c72-da31-47b6-a79c-e4e706a01b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.090459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32641c72-da31-47b6-a79c-e4e706a01b7c None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.091472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32641c72-da31-47b6-a79c-e4e706a01b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:52.092398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32641c72-da31-47b6-a79c-e4e706a01b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:52.094876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32641c72-da31-47b6-a79c-e4e706a01b7c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:52.102205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 345/695] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jun 21 15:44:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:52.103663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710883b2-4d28-45de-8621-ae456cd694fb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.104011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710883b2-4d28-45de-8621-ae456cd694fb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.104349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710883b2-4d28-45de-8621-ae456cd694fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.112464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 351/696] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:52.113672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32641c72-da31-47b6-a79c-e4e706a01b7c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:52.121950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-710883b2-4d28-45de-8621-ae456cd694fb None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:52.123286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-710883b2-4d28-45de-8621-ae456cd694fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:52.180964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:52.189209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:52.221682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 346/697] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:52.222646 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710883b2-4d28-45de-8621-ae456cd694fb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:52.231776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32641c72-da31-47b6-a79c-e4e706a01b7c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:52.275617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb28e1-a20e-4b24-a48f-f5dc473b884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:52.276635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb28e1-a20e-4b24-a48f-f5dc473b884b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.277152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb28e1-a20e-4b24-a48f-f5dc473b884b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.277636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb28e1-a20e-4b24-a48f-f5dc473b884b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.354746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710883b2-4d28-45de-8621-ae456cd694fb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:52.361961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb28e1-a20e-4b24-a48f-f5dc473b884b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:52.363611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb28e1-a20e-4b24-a48f-f5dc473b884b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:52.393488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ad39-0469-4ccc-ab92-6d9b4f032303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:52.394646 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ad39-0469-4ccc-ab92-6d9b4f032303 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.395130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ad39-0469-4ccc-ab92-6d9b4f032303 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.395647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ad39-0469-4ccc-ab92-6d9b4f032303 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.403946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2ad39-0469-4ccc-ab92-6d9b4f032303 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:52.405716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2ad39-0469-4ccc-ab92-6d9b4f032303 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-97b2ad39-0469-4ccc-ab92-6d9b4f032303 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:52.420871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:52.421799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:52.422723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:52.422723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:52.422723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:52.422723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:52.422723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:52.422723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:52.422723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:52.422723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:52.425279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 347/698] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:52.426374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ad39-0469-4ccc-ab92-6d9b4f032303 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:52.435989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:52.466730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:52.473653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 352/699] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:52.474511 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb28e1-a20e-4b24-a48f-f5dc473b884b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:52.539766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ad39-0469-4ccc-ab92-6d9b4f032303 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:52.579399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf87c62-5dbc-49c5-8b0c-fd159c7da672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:52.579617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb28e1-a20e-4b24-a48f-f5dc473b884b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:52.580682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf87c62-5dbc-49c5-8b0c-fd159c7da672 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.581197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf87c62-5dbc-49c5-8b0c-fd159c7da672 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.581683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf87c62-5dbc-49c5-8b0c-fd159c7da672 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.582547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf87c62-5dbc-49c5-8b0c-fd159c7da672 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:52.584184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf87c62-5dbc-49c5-8b0c-fd159c7da672 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ecf87c62-5dbc-49c5-8b0c-fd159c7da672 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:52.599927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:52.600917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:44:52.602336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:52.605473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 348/700] 10.222.0.46 () {56 vars in 1129 bytes} [Tue Jun 21 15:44:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:52.606626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf87c62-5dbc-49c5-8b0c-fd159c7da672 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:52.621979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300b2ee-c7f6-4f13-89d1-54e3883b1c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:52.622605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300b2ee-c7f6-4f13-89d1-54e3883b1c32 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.622886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300b2ee-c7f6-4f13-89d1-54e3883b1c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.623221 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300b2ee-c7f6-4f13-89d1-54e3883b1c32 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.624030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300b2ee-c7f6-4f13-89d1-54e3883b1c32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:52.624320 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300b2ee-c7f6-4f13-89d1-54e3883b1c32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:52.625756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300b2ee-c7f6-4f13-89d1-54e3883b1c32 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:52.639803 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 353/701] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:52.640717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300b2ee-c7f6-4f13-89d1-54e3883b1c32 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:52.683911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:52.720077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:52.724353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf87c62-5dbc-49c5-8b0c-fd159c7da672 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:52.747460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300b2ee-c7f6-4f13-89d1-54e3883b1c32 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:52.762435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac69d1-cc3a-45e1-bee2-b6ff453e292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:52.763924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac69d1-cc3a-45e1-bee2-b6ff453e292b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.764416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac69d1-cc3a-45e1-bee2-b6ff453e292b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.764923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac69d1-cc3a-45e1-bee2-b6ff453e292b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.777598 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac69d1-cc3a-45e1-bee2-b6ff453e292b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:52.779616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac69d1-cc3a-45e1-bee2-b6ff453e292b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:52.785165 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319036f6-18b2-4bc0-ac7e-3dc29bad35b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:52.785838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319036f6-18b2-4bc0-ac7e-3dc29bad35b0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.786132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319036f6-18b2-4bc0-ac7e-3dc29bad35b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.786410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319036f6-18b2-4bc0-ac7e-3dc29bad35b0 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.787120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319036f6-18b2-4bc0-ac7e-3dc29bad35b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:52.787498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319036f6-18b2-4bc0-ac7e-3dc29bad35b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:52.789481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319036f6-18b2-4bc0-ac7e-3dc29bad35b0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:52.799054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 354/702] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jun 21 15:44:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:52.799955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319036f6-18b2-4bc0-ac7e-3dc29bad35b0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5eac69d1-cc3a-45e1-bee2-b6ff453e292b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:52.801333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:52.802161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:52.803064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:52.803064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:52.803064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:52.803064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:52.805901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 349/703] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:52.806966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac69d1-cc3a-45e1-bee2-b6ff453e292b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:52.901395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:52.914818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319036f6-18b2-4bc0-ac7e-3dc29bad35b0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:52.918718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac69d1-cc3a-45e1-bee2-b6ff453e292b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:52.959629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e504-db98-45cc-98a2-466a3b2d7cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:52.960298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e504-db98-45cc-98a2-466a3b2d7cef None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.961242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e504-db98-45cc-98a2-466a3b2d7cef None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.961972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e504-db98-45cc-98a2-466a3b2d7cef None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.962958 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5e504-db98-45cc-98a2-466a3b2d7cef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:52.963232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5e504-db98-45cc-98a2-466a3b2d7cef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:52.964412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5e504-db98-45cc-98a2-466a3b2d7cef None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:52.965478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff1f04-c234-4828-934b-0ca6869d01ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:52.966216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff1f04-c234-4828-934b-0ca6869d01ea None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.966581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff1f04-c234-4828-934b-0ca6869d01ea None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.966951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff1f04-c234-4828-934b-0ca6869d01ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.967914 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff1f04-c234-4828-934b-0ca6869d01ea None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=35ec9ea691c141eb86bf7a825fbb80ed) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:52.968308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff1f04-c234-4828-934b-0ca6869d01ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:52.969826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff1f04-c234-4828-934b-0ca6869d01ea None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:52.979509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 350/704] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jun 21 15:44:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:52.979509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e504-db98-45cc-98a2-466a3b2d7cef None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:52.979775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 355/705] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:52 2022] GET /identity/v3/role_assignments?user.id=35ec9ea691c141eb86bf7a825fbb80ed&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:52.979775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf9a19-ba35-4fed-a4d4-41cb044b84b8 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.979775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf9a19-ba35-4fed-a4d4-41cb044b84b8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.979775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf9a19-ba35-4fed-a4d4-41cb044b84b8 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:52.985067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 356/706] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:52.986660 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b89a-c839-4bac-8ade-a0dd4c263a20 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:52.987023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b89a-c839-4bac-8ade-a0dd4c263a20 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:52.987555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940b89a-c839-4bac-8ade-a0dd4c263a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:53.016415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a940b89a-c839-4bac-8ade-a0dd4c263a20 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:53.017704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a940b89a-c839-4bac-8ade-a0dd4c263a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:53.042769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:53.174037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 357/707] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:53.186369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e504-db98-45cc-98a2-466a3b2d7cef None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:53.205035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940b89a-c839-4bac-8ade-a0dd4c263a20 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:53.230061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf602b-a060-48e0-8791-30ebd1219454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:53.230727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf602b-a060-48e0-8791-30ebd1219454 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:53.231013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf602b-a060-48e0-8791-30ebd1219454 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:53.231318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf602b-a060-48e0-8791-30ebd1219454 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:53.232044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf602b-a060-48e0-8791-30ebd1219454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:53.232350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf602b-a060-48e0-8791-30ebd1219454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:53.234216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf602b-a060-48e0-8791-30ebd1219454 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:53.252531 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 351/708] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:53.258506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf602b-a060-48e0-8791-30ebd1219454 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:53.331203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:53.353536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:53.355386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940b89a-c839-4bac-8ade-a0dd4c263a20 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:53.385264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf602b-a060-48e0-8791-30ebd1219454 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:53.402856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04f553-c269-4247-93de-ad3f93c786db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:53.403705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04f553-c269-4247-93de-ad3f93c786db None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:53.404020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04f553-c269-4247-93de-ad3f93c786db None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:53.404560 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04f553-c269-4247-93de-ad3f93c786db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:53.422979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04f553-c269-4247-93de-ad3f93c786db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:53.425207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04f553-c269-4247-93de-ad3f93c786db None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:53.429992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfef04-8a10-45e6-8cb4-ba51b6a8d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:53.431377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfef04-8a10-45e6-8cb4-ba51b6a8d00b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:53.431915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfef04-8a10-45e6-8cb4-ba51b6a8d00b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:53.432449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfef04-8a10-45e6-8cb4-ba51b6a8d00b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:53.441206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfef04-8a10-45e6-8cb4-ba51b6a8d00b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:53.443066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfef04-8a10-45e6-8cb4-ba51b6a8d00b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-4f04f553-c269-4247-93de-ad3f93c786db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:53.449216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:53.450171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:53.451097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:53.451097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:53.451097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:53.451097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:53.451097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 358/709] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:53.456919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04f553-c269-4247-93de-ad3f93c786db None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8fcfef04-8a10-45e6-8cb4-ba51b6a8d00b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:53.463980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:53.464890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:53.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:53.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:53.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:53.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:53.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:53.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:53.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:53.465806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:53.468347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 352/710] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:53.476280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfef04-8a10-45e6-8cb4-ba51b6a8d00b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:53.568616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04f553-c269-4247-93de-ad3f93c786db None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:53.667726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971455d-e8c5-44b6-b2af-db45d8b6969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:53.668411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971455d-e8c5-44b6-b2af-db45d8b6969f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:53.668701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971455d-e8c5-44b6-b2af-db45d8b6969f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:53.668987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971455d-e8c5-44b6-b2af-db45d8b6969f None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:53.669732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971455d-e8c5-44b6-b2af-db45d8b6969f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:53.670049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971455d-e8c5-44b6-b2af-db45d8b6969f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:53.671466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971455d-e8c5-44b6-b2af-db45d8b6969f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:53.676935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfef04-8a10-45e6-8cb4-ba51b6a8d00b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:53.687537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:53.704005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 359/711] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:53.706855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971455d-e8c5-44b6-b2af-db45d8b6969f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:53.750192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb619e-be89-448f-90e6-c1bcd5ac05b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:53.750868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb619e-be89-448f-90e6-c1bcd5ac05b8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:53.751176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb619e-be89-448f-90e6-c1bcd5ac05b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:53.751464 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb619e-be89-448f-90e6-c1bcd5ac05b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:53.752263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb619e-be89-448f-90e6-c1bcd5ac05b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:53.752584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb619e-be89-448f-90e6-c1bcd5ac05b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:53.754044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb619e-be89-448f-90e6-c1bcd5ac05b8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:53.765689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:53.790122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 353/712] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:53.795963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb619e-be89-448f-90e6-c1bcd5ac05b8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:53.887212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971455d-e8c5-44b6-b2af-db45d8b6969f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:53.912982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb619e-be89-448f-90e6-c1bcd5ac05b8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:53.924502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754aa34-0e15-4e4c-96d4-aa2ce1f1c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:53.925180 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754aa34-0e15-4e4c-96d4-aa2ce1f1c614 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:53.925474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754aa34-0e15-4e4c-96d4-aa2ce1f1c614 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:53.925759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754aa34-0e15-4e4c-96d4-aa2ce1f1c614 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:53.926477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754aa34-0e15-4e4c-96d4-aa2ce1f1c614 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:53.928040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754aa34-0e15-4e4c-96d4-aa2ce1f1c614 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:53.950971 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68870e48-a879-47b9-9e49-ec7b7f780503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:53.951808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870e48-a879-47b9-9e49-ec7b7f780503 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:53.952348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870e48-a879-47b9-9e49-ec7b7f780503 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:53.952845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870e48-a879-47b9-9e49-ec7b7f780503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:53.953752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68870e48-a879-47b9-9e49-ec7b7f780503 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2ab989a935eb4d91a94611cededd3cf6) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:53.954077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68870e48-a879-47b9-9e49-ec7b7f780503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:53.955563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68870e48-a879-47b9-9e49-ec7b7f780503 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:53.962341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 354/713] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:53 2022] GET /identity/v3/role_assignments?user.id=2ab989a935eb4d91a94611cededd3cf6&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=29dae918965d40bea71d83ffa2085316 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:53.971359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 360/714] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:44:53 2022] POST /identity/v3/users => generated 254 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:44:54.031809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d337aab-dde6-4e9b-b17b-18ea4bcdbebe None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:54.032405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d337aab-dde6-4e9b-b17b-18ea4bcdbebe None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:54.032852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d337aab-dde6-4e9b-b17b-18ea4bcdbebe None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:54.034838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 355/715] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:54.040973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bce06a-1e24-4503-9d61-f145fd55203b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:54.041345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bce06a-1e24-4503-9d61-f145fd55203b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:54.041643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bce06a-1e24-4503-9d61-f145fd55203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:54.068368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-37bce06a-1e24-4503-9d61-f145fd55203b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:54.069606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-37bce06a-1e24-4503-9d61-f145fd55203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:54.135698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:54.166465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 361/716] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:54.212874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d337aab-dde6-4e9b-b17b-18ea4bcdbebe None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:54.283514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:54.328863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d337aab-dde6-4e9b-b17b-18ea4bcdbebe None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:54.369997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4a5bc-9621-40e0-a88d-d38cf0b09095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:54.370801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4a5bc-9621-40e0-a88d-d38cf0b09095 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:54.371086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4a5bc-9621-40e0-a88d-d38cf0b09095 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:54.371440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4a5bc-9621-40e0-a88d-d38cf0b09095 None admin] PATH_INFO: `/v3/services/network` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:54.372102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4a5bc-9621-40e0-a88d-d38cf0b09095 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:54.373718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4a5bc-9621-40e0-a88d-d38cf0b09095 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4fe4a5bc-9621-40e0-a88d-d38cf0b09095 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:54.387139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:54.388890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:44:54.389718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:54.393642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 356/717] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:54 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:54.395022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bce06a-1e24-4503-9d61-f145fd55203b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:54.525435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bce06a-1e24-4503-9d61-f145fd55203b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:54.572041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378eb6d-e1fc-4f03-927f-855538540ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:54.572731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378eb6d-e1fc-4f03-927f-855538540ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:54.573066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378eb6d-e1fc-4f03-927f-855538540ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:54.573351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378eb6d-e1fc-4f03-927f-855538540ba1 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:54.574160 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378eb6d-e1fc-4f03-927f-855538540ba1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:54.574469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378eb6d-e1fc-4f03-927f-855538540ba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:54.576100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378eb6d-e1fc-4f03-927f-855538540ba1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:54.581902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 362/718] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:44:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:54.587211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4a5bc-9621-40e0-a88d-d38cf0b09095 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:54.731634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4a5bc-9621-40e0-a88d-d38cf0b09095 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:54.756290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:54.775409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879342c6-39e2-42d6-af7f-5ea84c7a1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:54.776143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879342c6-39e2-42d6-af7f-5ea84c7a1904 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:54.776381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879342c6-39e2-42d6-af7f-5ea84c7a1904 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:54.776664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879342c6-39e2-42d6-af7f-5ea84c7a1904 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:54.777391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879342c6-39e2-42d6-af7f-5ea84c7a1904 None admin] RBAC: Adding query filter params (type=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:54.777709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879342c6-39e2-42d6-af7f-5ea84c7a1904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:54.779094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879342c6-39e2-42d6-af7f-5ea84c7a1904 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:54.784370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 357/719] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:44:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:55.462799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac5203-7843-4574-a5d3-9855470f9ab5 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:55.463963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac5203-7843-4574-a5d3-9855470f9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:55.464463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac5203-7843-4574-a5d3-9855470f9ab5 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:55.466359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 363/720] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:55.471415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca81e9-13c8-430a-a094-f2d8b2940330 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:55.472254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca81e9-13c8-430a-a094-f2d8b2940330 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:55.472749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca81e9-13c8-430a-a094-f2d8b2940330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:55.494060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d3ca81e9-13c8-430a-a094-f2d8b2940330 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:55.495633 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d3ca81e9-13c8-430a-a094-f2d8b2940330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:55.580907 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 358/721] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:55.617271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac5203-7843-4574-a5d3-9855470f9ab5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:55.652514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db95a58-8360-445e-a525-e7f660e4b7ec None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:55.653135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db95a58-8360-445e-a525-e7f660e4b7ec None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:55.653612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db95a58-8360-445e-a525-e7f660e4b7ec None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:55.655277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 359/722] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:44:55.662099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d029d-2f64-4089-81ec-72e082718a1c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:55.662510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d029d-2f64-4089-81ec-72e082718a1c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:55.662891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d029d-2f64-4089-81ec-72e082718a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:55.694422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b55d029d-2f64-4089-81ec-72e082718a1c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:55.697057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b55d029d-2f64-4089-81ec-72e082718a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:55.702308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:55.779452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac5203-7843-4574-a5d3-9855470f9ab5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:55.829042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 360/723] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:55.844824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf9487-a552-4857-abab-926ff2d51e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:55.845489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf9487-a552-4857-abab-926ff2d51e15 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:55.845775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf9487-a552-4857-abab-926ff2d51e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:55.846058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf9487-a552-4857-abab-926ff2d51e15 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:55.846782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf9487-a552-4857-abab-926ff2d51e15 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:55.848195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf9487-a552-4857-abab-926ff2d51e15 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:55.853767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d029d-2f64-4089-81ec-72e082718a1c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:55.878451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 364/724] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:44:55 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:44:55.913863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:56.012411 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d029d-2f64-4089-81ec-72e082718a1c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:56.067126 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e29ca-578b-4ca8-9089-754734ea7c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:56.067885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e29ca-578b-4ca8-9089-754734ea7c77 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:56.068170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e29ca-578b-4ca8-9089-754734ea7c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:56.068446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e29ca-578b-4ca8-9089-754734ea7c77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:56.088151 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e29ca-578b-4ca8-9089-754734ea7c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d44e29ca-578b-4ca8-9089-754734ea7c77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:56.100077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:56.101620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:56.102475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 361/725] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:44:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:56.109473 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf9487-a552-4857-abab-926ff2d51e15 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:56.217480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf9487-a552-4857-abab-926ff2d51e15 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:56.227546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:56.255635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fefc1c-12a0-4d7b-890f-2fc6b5241ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:56.256317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefc1c-12a0-4d7b-890f-2fc6b5241ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:56.256612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefc1c-12a0-4d7b-890f-2fc6b5241ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:56.256898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefc1c-12a0-4d7b-890f-2fc6b5241ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:56.258376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fefc1c-12a0-4d7b-890f-2fc6b5241ea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:56.258698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fefc1c-12a0-4d7b-890f-2fc6b5241ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:56.260127 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fefc1c-12a0-4d7b-890f-2fc6b5241ea1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:56.269669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 365/726] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:56.275523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e29ca-578b-4ca8-9089-754734ea7c77 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:56.383100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e29ca-578b-4ca8-9089-754734ea7c77 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:56.385688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:56.420958 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009998a6-fb76-419a-86eb-f8f02692ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:56.421765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009998a6-fb76-419a-86eb-f8f02692ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:56.422055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009998a6-fb76-419a-86eb-f8f02692ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:56.422393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009998a6-fb76-419a-86eb-f8f02692ceb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:56.434062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009998a6-fb76-419a-86eb-f8f02692ceb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:56.435586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009998a6-fb76-419a-86eb-f8f02692ceb6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-009998a6-fb76-419a-86eb-f8f02692ceb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:56.454950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:56.455978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:56.456850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:56.456850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:56.456850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:56.456850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:56.456850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 362/727] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:56.463046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fefc1c-12a0-4d7b-890f-2fc6b5241ea1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:56.589183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fefc1c-12a0-4d7b-890f-2fc6b5241ea1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:56.626150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a18780-e3ce-4dd4-8f7f-c2e358d9417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:56.626825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a18780-e3ce-4dd4-8f7f-c2e358d9417e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:56.627187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a18780-e3ce-4dd4-8f7f-c2e358d9417e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:56.627516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a18780-e3ce-4dd4-8f7f-c2e358d9417e None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:56.628253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a18780-e3ce-4dd4-8f7f-c2e358d9417e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:56.628565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a18780-e3ce-4dd4-8f7f-c2e358d9417e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:56.629941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a18780-e3ce-4dd4-8f7f-c2e358d9417e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:56.643407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 366/728] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:56.649383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009998a6-fb76-419a-86eb-f8f02692ceb6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:56.715955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d1292-02d4-455b-833d-2dcffb55c8c1 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:56.716618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d1292-02d4-455b-833d-2dcffb55c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:56.717099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d1292-02d4-455b-833d-2dcffb55c8c1 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:56.718658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 367/729] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:44:56.730425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128738ac-92a4-477a-a886-ef5a47a55dda None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:56.731019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128738ac-92a4-477a-a886-ef5a47a55dda None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:56.731545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128738ac-92a4-477a-a886-ef5a47a55dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:56.765519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009998a6-fb76-419a-86eb-f8f02692ceb6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:56.780218 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-128738ac-92a4-477a-a886-ef5a47a55dda None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:56.781564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-128738ac-92a4-477a-a886-ef5a47a55dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:56.802037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a078-ac52-4c45-b0e6-766666acc78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:56.803142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a078-ac52-4c45-b0e6-766666acc78f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:56.803588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a078-ac52-4c45-b0e6-766666acc78f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:56.804539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a078-ac52-4c45-b0e6-766666acc78f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:56.820472 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504a078-ac52-4c45-b0e6-766666acc78f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:56.824610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504a078-ac52-4c45-b0e6-766666acc78f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:56.838529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5504a078-ac52-4c45-b0e6-766666acc78f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:56.848525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:56.849522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:56.850486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:56.850486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:56.850486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:56.850486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:56.850486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:56.850486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:56.850486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:56.850486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:56.850486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:44:56.850486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:56.853810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 363/730] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:44:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:44:56.859516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a078-ac52-4c45-b0e6-766666acc78f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:56.880962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:56.926284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 368/731] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:56.927663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6ac7b-508b-45e9-8e65-894ca41650bb None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:56.927962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6ac7b-508b-45e9-8e65-894ca41650bb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:56.928242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6ac7b-508b-45e9-8e65-894ca41650bb None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:56.934044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 369/732] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:56.935282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba3d21-f697-4d23-9adc-9602280b4d5b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:56.935583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba3d21-f697-4d23-9adc-9602280b4d5b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:56.935867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba3d21-f697-4d23-9adc-9602280b4d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:56.954844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-14ba3d21-f697-4d23-9adc-9602280b4d5b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:56.956087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-14ba3d21-f697-4d23-9adc-9602280b4d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:57.007789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a078-ac52-4c45-b0e6-766666acc78f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:57.054215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec456c4f-1d19-48fb-8e23-4a63e0faf80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:57.054957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec456c4f-1d19-48fb-8e23-4a63e0faf80e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:57.055287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec456c4f-1d19-48fb-8e23-4a63e0faf80e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:57.055575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec456c4f-1d19-48fb-8e23-4a63e0faf80e None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:57.056878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec456c4f-1d19-48fb-8e23-4a63e0faf80e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:57.057505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec456c4f-1d19-48fb-8e23-4a63e0faf80e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:57.059020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 370/733] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:44:57.060082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba3d21-f697-4d23-9adc-9602280b4d5b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:57.064313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec456c4f-1d19-48fb-8e23-4a63e0faf80e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:57.113741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 364/734] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jun 21 15:44:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:44:57.114622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec456c4f-1d19-48fb-8e23-4a63e0faf80e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:57.189880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:57.202492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:57.205894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba3d21-f697-4d23-9adc-9602280b4d5b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:57.232655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec456c4f-1d19-48fb-8e23-4a63e0faf80e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:57.258496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f39d89-6355-455a-8d15-62e41cbee425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:57.260064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39d89-6355-455a-8d15-62e41cbee425 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:57.260615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39d89-6355-455a-8d15-62e41cbee425 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:57.261401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39d89-6355-455a-8d15-62e41cbee425 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:57.275823 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221ac78-5f37-4adb-aba0-0ecbdd605e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:57.276985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221ac78-5f37-4adb-aba0-0ecbdd605e27 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:57.277403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221ac78-5f37-4adb-aba0-0ecbdd605e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:57.277852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221ac78-5f37-4adb-aba0-0ecbdd605e27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:57.278046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f39d89-6355-455a-8d15-62e41cbee425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-40f39d89-6355-455a-8d15-62e41cbee425 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:57.288688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:57.289707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:44:57.290564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:57.292816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221ac78-5f37-4adb-aba0-0ecbdd605e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:44:57.292935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 371/735] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:44:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:57.293672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f39d89-6355-455a-8d15-62e41cbee425 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a221ac78-5f37-4adb-aba0-0ecbdd605e27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:44:57.302889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:57.303966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:44:57.304910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:57.307850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 365/736] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:44:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:57.308846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221ac78-5f37-4adb-aba0-0ecbdd605e27 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:57.420220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f39d89-6355-455a-8d15-62e41cbee425 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:57.457397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221ac78-5f37-4adb-aba0-0ecbdd605e27 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:57.464485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40711f0-964e-4de1-853b-84dfb575300b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:57.465440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40711f0-964e-4de1-853b-84dfb575300b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:57.465913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40711f0-964e-4de1-853b-84dfb575300b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:57.466322 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40711f0-964e-4de1-853b-84dfb575300b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:57.491977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:57.500448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd2bcb-faea-4792-8200-8cee3aa7c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:57.501357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd2bcb-faea-4792-8200-8cee3aa7c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:57.501765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd2bcb-faea-4792-8200-8cee3aa7c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:57.502146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd2bcb-faea-4792-8200-8cee3aa7c1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:57.503035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd2bcb-faea-4792-8200-8cee3aa7c1c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:57.503515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd2bcb-faea-4792-8200-8cee3aa7c1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:57.505214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd2bcb-faea-4792-8200-8cee3aa7c1c4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:57.507025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:57.518987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 366/737] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:44:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:57.520075 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd2bcb-faea-4792-8200-8cee3aa7c1c4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:57.563441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40711f0-964e-4de1-853b-84dfb575300b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:57.565184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40711f0-964e-4de1-853b-84dfb575300b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:57.653607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd2bcb-faea-4792-8200-8cee3aa7c1c4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:57.693429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 372/738] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:57 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:44:57.694631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40711f0-964e-4de1-853b-84dfb575300b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:57.703190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92dc99-97de-49bf-a4e4-fddf0218a79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:57.703867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92dc99-97de-49bf-a4e4-fddf0218a79c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:57.704160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92dc99-97de-49bf-a4e4-fddf0218a79c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:57.704441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92dc99-97de-49bf-a4e4-fddf0218a79c None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:57.705199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92dc99-97de-49bf-a4e4-fddf0218a79c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:57.705511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92dc99-97de-49bf-a4e4-fddf0218a79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:57.706918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92dc99-97de-49bf-a4e4-fddf0218a79c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:57.716818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 367/739] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:44:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:57.718373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792eb67-e70e-4fe0-af04-81a6886a3964 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:57.718671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792eb67-e70e-4fe0-af04-81a6886a3964 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:57.719002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792eb67-e70e-4fe0-af04-81a6886a3964 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:57.720231 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 368/740] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:57.721062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792eb67-e70e-4fe0-af04-81a6886a3964 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:57.768665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:57.793817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:57.827325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40711f0-964e-4de1-853b-84dfb575300b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:57.844519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792eb67-e70e-4fe0-af04-81a6886a3964 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:57.866431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c014e32-520c-4f02-9498-1481581c641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:57.867227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c014e32-520c-4f02-9498-1481581c641b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:57.867520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c014e32-520c-4f02-9498-1481581c641b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:57.867799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c014e32-520c-4f02-9498-1481581c641b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:57.878586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c014e32-520c-4f02-9498-1481581c641b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:57.880105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c014e32-520c-4f02-9498-1481581c641b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:57.884839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49323f-3aa1-42a0-b17e-d6fb048d6c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:57.885693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49323f-3aa1-42a0-b17e-d6fb048d6c7c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:57.885934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49323f-3aa1-42a0-b17e-d6fb048d6c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:57.886214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49323f-3aa1-42a0-b17e-d6fb048d6c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:57.898202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49323f-3aa1-42a0-b17e-d6fb048d6c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:57.900330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49323f-3aa1-42a0-b17e-d6fb048d6c7c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-1c014e32-520c-4f02-9498-1481581c641b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:57.902590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:57.903628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:57.904617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:57.904617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:57.904617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:57.904617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:57.904617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 373/741] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:57.904617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c014e32-520c-4f02-9498-1481581c641b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4c49323f-3aa1-42a0-b17e-d6fb048d6c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:57.921805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:57.922748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:57.923672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:57.923672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:57.923672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:57.923672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:57.923672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 369/742] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:57.924619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc4191-74d8-450b-a00d-d449ecfc5830 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:57.924619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc4191-74d8-450b-a00d-d449ecfc5830 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:57.924777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc4191-74d8-450b-a00d-d449ecfc5830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:57.948322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ddcc4191-74d8-450b-a00d-d449ecfc5830 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:57.949295 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ddcc4191-74d8-450b-a00d-d449ecfc5830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:58.027741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c014e32-520c-4f02-9498-1481581c641b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:58.029368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:58.035452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 370/743] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:57 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:44:58.036381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc4191-74d8-450b-a00d-d449ecfc5830 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:58.068812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ee8de-8097-48ae-b17f-8e61c92237a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:58.069682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee8de-8097-48ae-b17f-8e61c92237a6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.069981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee8de-8097-48ae-b17f-8e61c92237a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.070263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ee8de-8097-48ae-b17f-8e61c92237a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.080890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ee8de-8097-48ae-b17f-8e61c92237a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:58.082510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ee8de-8097-48ae-b17f-8e61c92237a6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:58.091153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a07ee8de-8097-48ae-b17f-8e61c92237a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:58.110466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:58.114214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:58.118313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:58.118313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:58.118313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:58.118313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:58.118313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 374/744] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:58.118313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ee8de-8097-48ae-b17f-8e61c92237a6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:58.166835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc4191-74d8-450b-a00d-d449ecfc5830 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:58.207119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce95458-096f-4fec-b804-785f856600b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:58.207820 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce95458-096f-4fec-b804-785f856600b3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.208134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce95458-096f-4fec-b804-785f856600b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.208420 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce95458-096f-4fec-b804-785f856600b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.209169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce95458-096f-4fec-b804-785f856600b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:58.209481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce95458-096f-4fec-b804-785f856600b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:58.211215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce95458-096f-4fec-b804-785f856600b3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:58.223503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 371/745] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:58.224279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce95458-096f-4fec-b804-785f856600b3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:58.240475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ee8de-8097-48ae-b17f-8e61c92237a6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:58.285351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f626a8-c2c7-4c95-a947-7ae130ec02b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:58.285965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f626a8-c2c7-4c95-a947-7ae130ec02b3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.286416 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f626a8-c2c7-4c95-a947-7ae130ec02b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.286704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f626a8-c2c7-4c95-a947-7ae130ec02b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.287485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f626a8-c2c7-4c95-a947-7ae130ec02b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:58.287801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f626a8-c2c7-4c95-a947-7ae130ec02b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:58.289840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f626a8-c2c7-4c95-a947-7ae130ec02b3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:58.306704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 375/746] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:58.306704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f626a8-c2c7-4c95-a947-7ae130ec02b3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:58.323549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:58.341631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:58.344987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce95458-096f-4fec-b804-785f856600b3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:58.384306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f4cab-f49a-4ad6-8687-68f936206821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:58.385079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f4cab-f49a-4ad6-8687-68f936206821 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.385375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f4cab-f49a-4ad6-8687-68f936206821 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.385656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f4cab-f49a-4ad6-8687-68f936206821 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.386389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f4cab-f49a-4ad6-8687-68f936206821 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:58.387802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f4cab-f49a-4ad6-8687-68f936206821 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:58.405037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 372/747] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:44:58 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:44:58.405803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f4cab-f49a-4ad6-8687-68f936206821 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:58.448857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f626a8-c2c7-4c95-a947-7ae130ec02b3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:58.518175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb048e2-50e0-433b-a62c-fda90e55bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:58.520024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb048e2-50e0-433b-a62c-fda90e55bc45 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.520314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb048e2-50e0-433b-a62c-fda90e55bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.520596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb048e2-50e0-433b-a62c-fda90e55bc45 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.521347 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb048e2-50e0-433b-a62c-fda90e55bc45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:58.521659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb048e2-50e0-433b-a62c-fda90e55bc45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:58.524953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb048e2-50e0-433b-a62c-fda90e55bc45 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:58.540841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 376/748] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:58.541380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb048e2-50e0-433b-a62c-fda90e55bc45 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:58.553784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f4cab-f49a-4ad6-8687-68f936206821 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:58.603123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8ff9d-f444-4ac4-abc3-110c1a0c08b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:58.604343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8ff9d-f444-4ac4-abc3-110c1a0c08b2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.604635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8ff9d-f444-4ac4-abc3-110c1a0c08b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.604941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8ff9d-f444-4ac4-abc3-110c1a0c08b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.617054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8ff9d-f444-4ac4-abc3-110c1a0c08b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:58.618603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8ff9d-f444-4ac4-abc3-110c1a0c08b2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:58.631340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3af8ff9d-f444-4ac4-abc3-110c1a0c08b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:58.635257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:58.636317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:58.637316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:58.637316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:58.637316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:58.637316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:58.637316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:58.637316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:58.637316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:58.637316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:58.637316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:44:58.637316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:58.640014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 373/749] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jun 21 15:44:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:58.640816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8ff9d-f444-4ac4-abc3-110c1a0c08b2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:58.670704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb048e2-50e0-433b-a62c-fda90e55bc45 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:58.670945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:58.706859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dd4dd-c003-4a1e-b686-49437a36d18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:58.707685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd4dd-c003-4a1e-b686-49437a36d18c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.707979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd4dd-c003-4a1e-b686-49437a36d18c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.708256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd4dd-c003-4a1e-b686-49437a36d18c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.717762 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dd4dd-c003-4a1e-b686-49437a36d18c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:58.719307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dd4dd-c003-4a1e-b686-49437a36d18c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-961dd4dd-c003-4a1e-b686-49437a36d18c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:44:58.737842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:58.738789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:58.740484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:44:58.740484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:44:58.740484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:44:58.740484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:44:58.740484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:44:58.740484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:44:58.740484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:44:58.740484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:58.740484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 377/750] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:58.740484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ed7ac-6eb3-4502-997f-7bc3536f0ec2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.741024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ed7ac-6eb3-4502-997f-7bc3536f0ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.741024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ed7ac-6eb3-4502-997f-7bc3536f0ec2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.743181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 378/751] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:44:58.745195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ed7ac-6eb3-4502-997f-7bc3536f0ec2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:58.773244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8ff9d-f444-4ac4-abc3-110c1a0c08b2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:58.814826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56674c78-180a-4673-95ef-c8e54e419214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:58.816509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56674c78-180a-4673-95ef-c8e54e419214 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.816986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56674c78-180a-4673-95ef-c8e54e419214 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.817603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56674c78-180a-4673-95ef-c8e54e419214 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.829069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56674c78-180a-4673-95ef-c8e54e419214 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:58.830529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56674c78-180a-4673-95ef-c8e54e419214 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-56674c78-180a-4673-95ef-c8e54e419214 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:44:58.846353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:58.847693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 374/752] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jun 21 15:44:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:58.848683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56674c78-180a-4673-95ef-c8e54e419214 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:58.866319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ed7ac-6eb3-4502-997f-7bc3536f0ec2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:58.902017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:58.910670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ed3d1-bf90-4397-9944-70f27367bd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:58.911386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ed3d1-bf90-4397-9944-70f27367bd22 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.911667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ed3d1-bf90-4397-9944-70f27367bd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.911953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ed3d1-bf90-4397-9944-70f27367bd22 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.912807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ed3d1-bf90-4397-9944-70f27367bd22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:58.913123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ed3d1-bf90-4397-9944-70f27367bd22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:58.914858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ed3d1-bf90-4397-9944-70f27367bd22 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:58.939203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 379/753] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jun 21 15:44:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:58.940210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c309a-2639-4533-b095-de0472b5e091 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:58.940509 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c309a-2639-4533-b095-de0472b5e091 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:58.940790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c309a-2639-4533-b095-de0472b5e091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:58.955221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:58.959888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d43c309a-2639-4533-b095-de0472b5e091 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:44:58.961661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d43c309a-2639-4533-b095-de0472b5e091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:44:58.977834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56674c78-180a-4673-95ef-c8e54e419214 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:59.030860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a247cd-8767-4015-994f-1495a9382523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:59.031681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a247cd-8767-4015-994f-1495a9382523 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:59.032037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a247cd-8767-4015-994f-1495a9382523 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:59.032380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a247cd-8767-4015-994f-1495a9382523 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:59.033246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a247cd-8767-4015-994f-1495a9382523 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:59.033628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a247cd-8767-4015-994f-1495a9382523 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:59.035133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a247cd-8767-4015-994f-1495a9382523 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:59.048388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 375/754] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:59.054459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a247cd-8767-4015-994f-1495a9382523 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:59.060327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 380/755] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:44:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:44:59.061530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c309a-2639-4533-b095-de0472b5e091 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:59.171316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a247cd-8767-4015-994f-1495a9382523 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:59.183490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c309a-2639-4533-b095-de0472b5e091 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:59.204138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:59.208268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fbda6-887b-4b8c-bda1-3e627a345d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:59.209047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fbda6-887b-4b8c-bda1-3e627a345d7b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:59.209334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fbda6-887b-4b8c-bda1-3e627a345d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:59.209613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fbda6-887b-4b8c-bda1-3e627a345d7b None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:59.210490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fbda6-887b-4b8c-bda1-3e627a345d7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:59.210800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fbda6-887b-4b8c-bda1-3e627a345d7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:59.212298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fbda6-887b-4b8c-bda1-3e627a345d7b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:59.222302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:59.227136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30359d-d6f9-44dd-bc56-3876b35ff390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:59.228375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30359d-d6f9-44dd-bc56-3876b35ff390 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:59.228666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30359d-d6f9-44dd-bc56-3876b35ff390 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:59.228946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30359d-d6f9-44dd-bc56-3876b35ff390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:59.233732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 376/756] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jun 21 15:44:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:59.234770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fbda6-887b-4b8c-bda1-3e627a345d7b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:59.301869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30359d-d6f9-44dd-bc56-3876b35ff390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:59.304819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30359d-d6f9-44dd-bc56-3876b35ff390 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:59.359695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fbda6-887b-4b8c-bda1-3e627a345d7b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:59.400905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3c03f-3d89-4b34-b6d1-e290cba4ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:59.401584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3c03f-3d89-4b34-b6d1-e290cba4ca61 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:59.401870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3c03f-3d89-4b34-b6d1-e290cba4ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:59.402153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3c03f-3d89-4b34-b6d1-e290cba4ca61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:59.403008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3c03f-3d89-4b34-b6d1-e290cba4ca61 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=35ec9ea691c141eb86bf7a825fbb80ed) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:59.403354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3c03f-3d89-4b34-b6d1-e290cba4ca61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:59.404818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3c03f-3d89-4b34-b6d1-e290cba4ca61 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:59.411149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 377/757] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:44:59 2022] GET /identity/v3/role_assignments?user.id=35ec9ea691c141eb86bf7a825fbb80ed&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=29dae918965d40bea71d83ffa2085316 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:59.411927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3c03f-3d89-4b34-b6d1-e290cba4ca61 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:59.440428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 381/758] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:44:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:44:59.441714 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30359d-d6f9-44dd-bc56-3876b35ff390 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:59.468990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:59.510350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:59.576019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3c03f-3d89-4b34-b6d1-e290cba4ca61 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:59.592957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30359d-d6f9-44dd-bc56-3876b35ff390 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:59.624305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad12de-73fa-4774-a74a-c521ba68ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:59.625843 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad12de-73fa-4774-a74a-c521ba68ac29 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:59.626880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad12de-73fa-4774-a74a-c521ba68ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:59.627582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad12de-73fa-4774-a74a-c521ba68ac29 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:59.628577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad12de-73fa-4774-a74a-c521ba68ac29 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:59.631152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad12de-73fa-4774-a74a-c521ba68ac29 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:59.641294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7934e8-801b-42a1-aa75-57d38adc10b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:59.642451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7934e8-801b-42a1-aa75-57d38adc10b6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:59.642912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7934e8-801b-42a1-aa75-57d38adc10b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:59.643389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7934e8-801b-42a1-aa75-57d38adc10b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6bad12de-73fa-4774-a74a-c521ba68ac29 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:59.647502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:59.649009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:44:59.650687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:59.655844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 378/759] 10.222.0.46 () {56 vars in 1129 bytes} [Tue Jun 21 15:44:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:59.656863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad12de-73fa-4774-a74a-c521ba68ac29 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:59.660232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7934e8-801b-42a1-aa75-57d38adc10b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:59.662695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7934e8-801b-42a1-aa75-57d38adc10b6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-cf7934e8-801b-42a1-aa75-57d38adc10b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:59.686002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:59.687124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:59.688219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:59.688219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:59.688219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:59.688219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:44:59.690400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 382/760] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:59.691408 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7934e8-801b-42a1-aa75-57d38adc10b6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:59.776214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad12de-73fa-4774-a74a-c521ba68ac29 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:59.791677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:59.804969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:44:59.815595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65508ce7-503e-4487-98d4-30707f118979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:59.816761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65508ce7-503e-4487-98d4-30707f118979 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:59.817258 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65508ce7-503e-4487-98d4-30707f118979 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:59.817768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65508ce7-503e-4487-98d4-30707f118979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:59.830158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65508ce7-503e-4487-98d4-30707f118979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:59.831694 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7934e8-801b-42a1-aa75-57d38adc10b6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:44:59.832240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65508ce7-503e-4487-98d4-30707f118979 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-65508ce7-503e-4487-98d4-30707f118979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:44:59.852588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:44:59.853540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:44:59.854463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:44:59.854463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:44:59.854463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:44:59.854463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:44:59.861114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 379/761] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:44:59.862411 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65508ce7-503e-4487-98d4-30707f118979 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:59.873615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8b167-fdd4-406b-81dc-436864d894a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:44:59.874290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b167-fdd4-406b-81dc-436864d894a9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:44:59.874573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b167-fdd4-406b-81dc-436864d894a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:44:59.874857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8b167-fdd4-406b-81dc-436864d894a9 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:44:59.875626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8b167-fdd4-406b-81dc-436864d894a9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:44:59.875936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8b167-fdd4-406b-81dc-436864d894a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:44:59.880606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8b167-fdd4-406b-81dc-436864d894a9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:44:59.884042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 383/762] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jun 21 15:44:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:44:59.885184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8b167-fdd4-406b-81dc-436864d894a9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:44:59.998884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65508ce7-503e-4487-98d4-30707f118979 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.029011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8b167-fdd4-406b-81dc-436864d894a9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.036319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cab52-39c3-4adb-96bd-d119b63dd7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.036996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cab52-39c3-4adb-96bd-d119b63dd7bb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.037284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cab52-39c3-4adb-96bd-d119b63dd7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.037573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cab52-39c3-4adb-96bd-d119b63dd7bb None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.038382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cab52-39c3-4adb-96bd-d119b63dd7bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:00.039265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cab52-39c3-4adb-96bd-d119b63dd7bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.040780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cab52-39c3-4adb-96bd-d119b63dd7bb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.060310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 380/763] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:00.060310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cab52-39c3-4adb-96bd-d119b63dd7bb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:00.078448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc22ed9-595e-4a76-8788-9c8104a8175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.079528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc22ed9-595e-4a76-8788-9c8104a8175f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.080050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc22ed9-595e-4a76-8788-9c8104a8175f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.080567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc22ed9-595e-4a76-8788-9c8104a8175f None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.081755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc22ed9-595e-4a76-8788-9c8104a8175f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:00.082300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc22ed9-595e-4a76-8788-9c8104a8175f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.083991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc22ed9-595e-4a76-8788-9c8104a8175f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.086318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:00.103773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 384/764] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:00.105178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc22ed9-595e-4a76-8788-9c8104a8175f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:00.105662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:00.169987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cab52-39c3-4adb-96bd-d119b63dd7bb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.207422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bb18e-c61e-4af8-9779-2dac31146b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.208093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bb18e-c61e-4af8-9779-2dac31146b1b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.208380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bb18e-c61e-4af8-9779-2dac31146b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.208659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bb18e-c61e-4af8-9779-2dac31146b1b None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.209368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bb18e-c61e-4af8-9779-2dac31146b1b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:00.209675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bb18e-c61e-4af8-9779-2dac31146b1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.211419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bb18e-c61e-4af8-9779-2dac31146b1b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.217214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 381/765] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jun 21 15:45:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:00.218025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bb18e-c61e-4af8-9779-2dac31146b1b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:00.225314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc22ed9-595e-4a76-8788-9c8104a8175f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.265119 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167185d-f99c-4e2c-8343-37e151da0869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.266391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167185d-f99c-4e2c-8343-37e151da0869 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.266888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167185d-f99c-4e2c-8343-37e151da0869 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.267452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167185d-f99c-4e2c-8343-37e151da0869 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.275821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167185d-f99c-4e2c-8343-37e151da0869 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.277607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167185d-f99c-4e2c-8343-37e151da0869 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9167185d-f99c-4e2c-8343-37e151da0869 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:00.294764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:00.295751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:00.296746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:00.296746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:00.296746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:00.296746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:00.296746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:00.296746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:00.296746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:00.296746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:00.303869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 385/766] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:00.306148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167185d-f99c-4e2c-8343-37e151da0869 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:00.325378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bb18e-c61e-4af8-9779-2dac31146b1b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.327027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:00.362317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317da16-dfaa-4b65-87e8-32a7eaf3dc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.363125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317da16-dfaa-4b65-87e8-32a7eaf3dc45 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.363434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317da16-dfaa-4b65-87e8-32a7eaf3dc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.363715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317da16-dfaa-4b65-87e8-32a7eaf3dc45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.371882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317da16-dfaa-4b65-87e8-32a7eaf3dc45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.373125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:00.374660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317da16-dfaa-4b65-87e8-32a7eaf3dc45 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1317da16-dfaa-4b65-87e8-32a7eaf3dc45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:00.390969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:00.391935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:00.392891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:00.392891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:00.392891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:00.392891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:00.392891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:00.392891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:00.392891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:00.392891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:00.396966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 382/767] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:00.397928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317da16-dfaa-4b65-87e8-32a7eaf3dc45 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:00.428764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167185d-f99c-4e2c-8343-37e151da0869 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.468603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e118b2-ce6e-4f11-9ea3-90db5d8bccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.469804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e118b2-ce6e-4f11-9ea3-90db5d8bccd5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.470366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e118b2-ce6e-4f11-9ea3-90db5d8bccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.470873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e118b2-ce6e-4f11-9ea3-90db5d8bccd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.472053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e118b2-ce6e-4f11-9ea3-90db5d8bccd5 None admin] RBAC: Adding query filter params (interface=public, service_id=91c32e25d52340a287d4f340738ebcd6, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:00.472633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e118b2-ce6e-4f11-9ea3-90db5d8bccd5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.474338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e118b2-ce6e-4f11-9ea3-90db5d8bccd5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.484500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 386/768] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jun 21 15:45:00 2022] GET /identity/v3/endpoints?service_id=91c32e25d52340a287d4f340738ebcd6&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:00.485832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e118b2-ce6e-4f11-9ea3-90db5d8bccd5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:00.506025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317da16-dfaa-4b65-87e8-32a7eaf3dc45 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.552081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c97a9e-0729-410b-9e23-ed2396796a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.552705 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c97a9e-0729-410b-9e23-ed2396796a1c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.552994 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c97a9e-0729-410b-9e23-ed2396796a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.553282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c97a9e-0729-410b-9e23-ed2396796a1c None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.554149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c97a9e-0729-410b-9e23-ed2396796a1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:00.554470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c97a9e-0729-410b-9e23-ed2396796a1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.556025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c97a9e-0729-410b-9e23-ed2396796a1c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.570879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 383/769] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:00.572027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c97a9e-0729-410b-9e23-ed2396796a1c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:00.602313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:00.623373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e118b2-ce6e-4f11-9ea3-90db5d8bccd5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.641503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:00.662527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c25a9b-d710-4887-9a30-bf7df2a52641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.663281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25a9b-d710-4887-9a30-bf7df2a52641 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.664112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25a9b-d710-4887-9a30-bf7df2a52641 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.664394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25a9b-d710-4887-9a30-bf7df2a52641 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.665831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c25a9b-d710-4887-9a30-bf7df2a52641 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:00.666191 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c25a9b-d710-4887-9a30-bf7df2a52641 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.668156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c25a9b-d710-4887-9a30-bf7df2a52641 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.681829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 387/770] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:00.682498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c25a9b-d710-4887-9a30-bf7df2a52641 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:00.696146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c97a9e-0729-410b-9e23-ed2396796a1c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.733172 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5898af-877e-4300-b440-f880e07e0184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.733844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5898af-877e-4300-b440-f880e07e0184 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.734136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5898af-877e-4300-b440-f880e07e0184 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.734419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5898af-877e-4300-b440-f880e07e0184 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.735109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5898af-877e-4300-b440-f880e07e0184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.736534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5898af-877e-4300-b440-f880e07e0184 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.742273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 384/771] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jun 21 15:45:00 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:00.743584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e482e-21e2-4c76-b034-0a93e7053860 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.743878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e482e-21e2-4c76-b034-0a93e7053860 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.744158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e482e-21e2-4c76-b034-0a93e7053860 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.745635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 385/772] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:00.750436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e482e-21e2-4c76-b034-0a93e7053860 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:00.819270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c25a9b-d710-4887-9a30-bf7df2a52641 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.855318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:00.861112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ad6e6-2f63-4a8c-b005-e897007d535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.861756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ad6e6-2f63-4a8c-b005-e897007d535b None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.862143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ad6e6-2f63-4a8c-b005-e897007d535b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.862521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ad6e6-2f63-4a8c-b005-e897007d535b None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2ab989a935eb4d91a94611cededd3cf6/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.864751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ad6e6-2f63-4a8c-b005-e897007d535b None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=2ab989a935eb4d91a94611cededd3cf6, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.867529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ad6e6-2f63-4a8c-b005-e897007d535b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.878197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e482e-21e2-4c76-b034-0a93e7053860 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:00.886748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 388/773] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:45:00 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2ab989a935eb4d91a94611cededd3cf6/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:45:00.890530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324011c-e2c3-4295-978f-f89da46515bb None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.893583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324011c-e2c3-4295-978f-f89da46515bb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.894070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324011c-e2c3-4295-978f-f89da46515bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.918822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7324011c-e2c3-4295-978f-f89da46515bb None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:00.920549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7324011c-e2c3-4295-978f-f89da46515bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:00.940316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c54c2-25c4-4cfe-a867-5d2b3bfd37b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:00.941005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c54c2-25c4-4cfe-a867-5d2b3bfd37b1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:00.941861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c54c2-25c4-4cfe-a867-5d2b3bfd37b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:00.941861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c54c2-25c4-4cfe-a867-5d2b3bfd37b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:00.942473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c54c2-25c4-4cfe-a867-5d2b3bfd37b1 None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=3bc3da0a04de412eb239aeb0b2e99eb3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:00.942793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c54c2-25c4-4cfe-a867-5d2b3bfd37b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:00.944350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c54c2-25c4-4cfe-a867-5d2b3bfd37b1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:00.959201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 386/774] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:00 2022] GET /identity/v3/role_assignments?user.id=3bc3da0a04de412eb239aeb0b2e99eb3&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:00.970170 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:01.020806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 389/775] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:01.052066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c54c2-25c4-4cfe-a867-5d2b3bfd37b1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:01.184316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c54c2-25c4-4cfe-a867-5d2b3bfd37b1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:01.221542 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd68d4-11f3-43da-91fd-36b75392c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:01.222354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd68d4-11f3-43da-91fd-36b75392c83f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:01.222638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd68d4-11f3-43da-91fd-36b75392c83f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:01.222915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd68d4-11f3-43da-91fd-36b75392c83f None admin] PATH_INFO: `/v3/services/network` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:01.223615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd68d4-11f3-43da-91fd-36b75392c83f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:01.224987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd68d4-11f3-43da-91fd-36b75392c83f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-67dd68d4-11f3-43da-91fd-36b75392c83f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:01.237968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:01.238965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:01.239846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 387/776] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:01 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:01.246872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324011c-e2c3-4295-978f-f89da46515bb None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:01.377052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324011c-e2c3-4295-978f-f89da46515bb None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:01.425402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e4b7-8e4c-4415-b5f9-bc7702888f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:01.426552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e4b7-8e4c-4415-b5f9-bc7702888f86 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:01.427084 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e4b7-8e4c-4415-b5f9-bc7702888f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:01.427624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e4b7-8e4c-4415-b5f9-bc7702888f86 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:01.429336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e4b7-8e4c-4415-b5f9-bc7702888f86 None admin] RBAC: Adding query filter params (name=network) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:01.430387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e4b7-8e4c-4415-b5f9-bc7702888f86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:01.431887 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e4b7-8e4c-4415-b5f9-bc7702888f86 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:01.439830 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 390/777] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:01.446072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd68d4-11f3-43da-91fd-36b75392c83f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:01.471390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:01.590003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd68d4-11f3-43da-91fd-36b75392c83f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:01.642039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2da6c-8398-4a8a-8637-bee33d888cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:01.642721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2da6c-8398-4a8a-8637-bee33d888cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:01.643011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2da6c-8398-4a8a-8637-bee33d888cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:01.643322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2da6c-8398-4a8a-8637-bee33d888cd8 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:01.644040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2da6c-8398-4a8a-8637-bee33d888cd8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:01.644350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2da6c-8398-4a8a-8637-bee33d888cd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:01.645723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2da6c-8398-4a8a-8637-bee33d888cd8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:01.655436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 388/778] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:01.661813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e4b7-8e4c-4415-b5f9-bc7702888f86 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:01.703853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1a226-821b-4a8e-9b39-8b5d26177a28 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:01.704153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1a226-821b-4a8e-9b39-8b5d26177a28 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:01.704349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1a226-821b-4a8e-9b39-8b5d26177a28 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:01.705988 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 389/779] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:01.717524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7d15c-621b-48a6-9c00-6b8b5be10121 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:01.717842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7d15c-621b-48a6-9c00-6b8b5be10121 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:01.718092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7d15c-621b-48a6-9c00-6b8b5be10121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:01.720122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:01.752533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-84c7d15c-621b-48a6-9c00-6b8b5be10121 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:01.753590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-84c7d15c-621b-48a6-9c00-6b8b5be10121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:01.799983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e4b7-8e4c-4415-b5f9-bc7702888f86 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:01.842940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad09c7d-7b04-475b-9c2a-37ff15dbf1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:01.843894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad09c7d-7b04-475b-9c2a-37ff15dbf1ce None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:01.846303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad09c7d-7b04-475b-9c2a-37ff15dbf1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:01.847010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad09c7d-7b04-475b-9c2a-37ff15dbf1ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:01.848632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad09c7d-7b04-475b-9c2a-37ff15dbf1ce None admin] RBAC: Adding query filter params (interface=public, service_id=8f269b1b01974578a5ddb60ff283c5f9, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:01.852716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad09c7d-7b04-475b-9c2a-37ff15dbf1ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:01.854505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad09c7d-7b04-475b-9c2a-37ff15dbf1ce None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:01.865547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 391/780] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jun 21 15:45:01 2022] GET /identity/v3/endpoints?service_id=8f269b1b01974578a5ddb60ff283c5f9&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:01.872445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad09c7d-7b04-475b-9c2a-37ff15dbf1ce None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:01.901718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 390/781] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:01.943397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7d15c-621b-48a6-9c00-6b8b5be10121 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:01.956466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:02.052212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:02.065336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad09c7d-7b04-475b-9c2a-37ff15dbf1ce None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:02.079669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7d15c-621b-48a6-9c00-6b8b5be10121 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:02.115667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254e2a3-718b-4434-aeba-423d8256026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:02.117302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254e2a3-718b-4434-aeba-423d8256026e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:02.117761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254e2a3-718b-4434-aeba-423d8256026e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:02.118197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254e2a3-718b-4434-aeba-423d8256026e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:02.129265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254e2a3-718b-4434-aeba-423d8256026e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1254e2a3-718b-4434-aeba-423d8256026e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:02.141367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:02.142503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:02.143604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:02.145750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 391/782] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:45:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:02.151918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254e2a3-718b-4434-aeba-423d8256026e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:02.172064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8f7b-21d0-4014-bbea-23725f8f59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:02.172743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8f7b-21d0-4014-bbea-23725f8f59a7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:02.173031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8f7b-21d0-4014-bbea-23725f8f59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:02.173314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8f7b-21d0-4014-bbea-23725f8f59a7 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:02.174004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8f7b-21d0-4014-bbea-23725f8f59a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:02.175414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8f7b-21d0-4014-bbea-23725f8f59a7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:02.188455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 392/783] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jun 21 15:45:01 2022] GET /identity/v3/services => generated 772 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:02.248254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:02.303048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254e2a3-718b-4434-aeba-423d8256026e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:02.360397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25703223-d010-47c8-83e9-f1773656fd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:02.361478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703223-d010-47c8-83e9-f1773656fd20 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:02.361977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703223-d010-47c8-83e9-f1773656fd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:02.362525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703223-d010-47c8-83e9-f1773656fd20 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:02.363584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25703223-d010-47c8-83e9-f1773656fd20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:02.364105 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25703223-d010-47c8-83e9-f1773656fd20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:02.365742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25703223-d010-47c8-83e9-f1773656fd20 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:02.375594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 392/784] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:02.381074 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8f7b-21d0-4014-bbea-23725f8f59a7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:02.496866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8f7b-21d0-4014-bbea-23725f8f59a7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:02.537112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b6ce7-64bf-4292-8843-1bff6af6a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:02.538830 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b6ce7-64bf-4292-8843-1bff6af6a31f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:02.539375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b6ce7-64bf-4292-8843-1bff6af6a31f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:02.539863 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b6ce7-64bf-4292-8843-1bff6af6a31f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:02.552237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b6ce7-64bf-4292-8843-1bff6af6a31f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:02.554316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b6ce7-64bf-4292-8843-1bff6af6a31f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7a8b6ce7-64bf-4292-8843-1bff6af6a31f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:02.580491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:02.581446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:02.582336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:02.582336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:02.582336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:02.582336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:02.582336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 393/785] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:02.588152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25703223-d010-47c8-83e9-f1773656fd20 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:02.811805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25703223-d010-47c8-83e9-f1773656fd20 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:02.862478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bd689-01a1-413c-b289-b5740033ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:02.863569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bd689-01a1-413c-b289-b5740033ea00 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:02.864069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bd689-01a1-413c-b289-b5740033ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:02.864552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bd689-01a1-413c-b289-b5740033ea00 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:02.865511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bd689-01a1-413c-b289-b5740033ea00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:02.866026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bd689-01a1-413c-b289-b5740033ea00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:02.867492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:02.871741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bd689-01a1-413c-b289-b5740033ea00 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:02.886808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 393/786] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:02.893580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b6ce7-64bf-4292-8843-1bff6af6a31f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:02.922657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:03.071796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b6ce7-64bf-4292-8843-1bff6af6a31f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:03.125173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbe8bf-79b6-406c-bee6-d07652c2a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:03.126356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbe8bf-79b6-406c-bee6-d07652c2a051 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:03.126868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbe8bf-79b6-406c-bee6-d07652c2a051 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:03.127407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbe8bf-79b6-406c-bee6-d07652c2a051 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:03.139857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbe8bf-79b6-406c-bee6-d07652c2a051 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:03.141645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbe8bf-79b6-406c-bee6-d07652c2a051 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-70dbe8bf-79b6-406c-bee6-d07652c2a051 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:03.162699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:03.164275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:03.165215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:03.165215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:03.165215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:03.165215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:03.165215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:03.165215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:03.165215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:03.165215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:03.165215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:45:03.165215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:03.167929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 394/787] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:45:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:03.173235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bd689-01a1-413c-b289-b5740033ea00 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:03.306270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bd689-01a1-413c-b289-b5740033ea00 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:03.362985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4898c-2173-4fae-8a0d-2b794f27490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:03.364067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4898c-2173-4fae-8a0d-2b794f27490c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:03.364578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4898c-2173-4fae-8a0d-2b794f27490c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:03.365066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4898c-2173-4fae-8a0d-2b794f27490c None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:03.366132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4898c-2173-4fae-8a0d-2b794f27490c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:03.367289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4898c-2173-4fae-8a0d-2b794f27490c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:03.369063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4898c-2173-4fae-8a0d-2b794f27490c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:03.394894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbe8bf-79b6-406c-bee6-d07652c2a051 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:03.396366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 394/788] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jun 21 15:45:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:03.407308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904b3d-246d-4f53-ba1d-2c3783ba84c3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:03.407932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904b3d-246d-4f53-ba1d-2c3783ba84c3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:03.408455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904b3d-246d-4f53-ba1d-2c3783ba84c3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:03.410422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 395/789] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:45:03.416848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561713f-f7f6-4fbb-9a78-b50132ebf393 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:03.417455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561713f-f7f6-4fbb-9a78-b50132ebf393 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:03.417947 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561713f-f7f6-4fbb-9a78-b50132ebf393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:03.451223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2561713f-f7f6-4fbb-9a78-b50132ebf393 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:03.453500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2561713f-f7f6-4fbb-9a78-b50132ebf393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:03.523265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:03.525120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:03.555732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 396/790] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:03.557539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6953a5-254b-4587-983f-5af314de3a25 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:03.558078 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6953a5-254b-4587-983f-5af314de3a25 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:03.558570 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6953a5-254b-4587-983f-5af314de3a25 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:03.560462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 397/791] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:03.568521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbe8bf-79b6-406c-bee6-d07652c2a051 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:03.571561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2571ad-6ae0-4445-8d3d-83313404c6ed None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:03.572118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2571ad-6ae0-4445-8d3d-83313404c6ed None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:03.572608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2571ad-6ae0-4445-8d3d-83313404c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:03.602644 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ea2571ad-6ae0-4445-8d3d-83313404c6ed None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:03.604161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ea2571ad-6ae0-4445-8d3d-83313404c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:03.610186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970bde6-1ca5-460c-90df-0cd3361c67ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:03.611113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970bde6-1ca5-460c-90df-0cd3361c67ec None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:03.611445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970bde6-1ca5-460c-90df-0cd3361c67ec None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:03.611725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970bde6-1ca5-460c-90df-0cd3361c67ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:03.624085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970bde6-1ca5-460c-90df-0cd3361c67ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:03.625584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970bde6-1ca5-460c-90df-0cd3361c67ec None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7970bde6-1ca5-460c-90df-0cd3361c67ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:03.646475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:03.647710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:03.648744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:03.648744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:03.648744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:03.648744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:03.648744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 395/792] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:03.649500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970bde6-1ca5-460c-90df-0cd3361c67ec None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:03.686086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 398/793] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:03.687385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2571ad-6ae0-4445-8d3d-83313404c6ed None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:03.799291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970bde6-1ca5-460c-90df-0cd3361c67ec None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:03.804055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2571ad-6ae0-4445-8d3d-83313404c6ed None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:03.815537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:03.829594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:03.842527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223150eb-b2b2-4cd4-83db-34b3436081ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:03.843596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223150eb-b2b2-4cd4-83db-34b3436081ed None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:03.843765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223150eb-b2b2-4cd4-83db-34b3436081ed None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:03.844051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223150eb-b2b2-4cd4-83db-34b3436081ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:03.849303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c38d05-f954-4d65-9b43-2b01906a55a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:03.850219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c38d05-f954-4d65-9b43-2b01906a55a4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:03.851292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c38d05-f954-4d65-9b43-2b01906a55a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:03.851667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c38d05-f954-4d65-9b43-2b01906a55a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:03.852627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c38d05-f954-4d65-9b43-2b01906a55a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:03.852886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c38d05-f954-4d65-9b43-2b01906a55a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:03.854227 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c38d05-f954-4d65-9b43-2b01906a55a4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:03.863181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223150eb-b2b2-4cd4-83db-34b3436081ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:03.869229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 399/794] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:03.870106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c38d05-f954-4d65-9b43-2b01906a55a4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-223150eb-b2b2-4cd4-83db-34b3436081ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:03.876701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:03.877988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:03.878900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 396/795] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:45:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:03.879625 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70664-053e-4d29-a905-b25daefce2c5 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:03.880174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70664-053e-4d29-a905-b25daefce2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:03.880174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70664-053e-4d29-a905-b25daefce2c5 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:03.883374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 397/796] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:03.883374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70664-053e-4d29-a905-b25daefce2c5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:03.998589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c38d05-f954-4d65-9b43-2b01906a55a4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:04.006248 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70664-053e-4d29-a905-b25daefce2c5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:04.034149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb92c8-b84f-411d-a601-4df66f72e188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:04.035236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb92c8-b84f-411d-a601-4df66f72e188 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.035601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb92c8-b84f-411d-a601-4df66f72e188 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.035887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb92c8-b84f-411d-a601-4df66f72e188 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.036554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb92c8-b84f-411d-a601-4df66f72e188 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:04.037954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb92c8-b84f-411d-a601-4df66f72e188 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:04.046864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b9df4-d2fa-48ff-91a6-9a1a4a3fa637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:04.047763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9df4-d2fa-48ff-91a6-9a1a4a3fa637 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.048055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9df4-d2fa-48ff-91a6-9a1a4a3fa637 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.048336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b9df4-d2fa-48ff-91a6-9a1a4a3fa637 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d3fb92c8-b84f-411d-a601-4df66f72e188 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:04.051757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:04.052654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:45:04.053515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:04.057086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b9df4-d2fa-48ff-91a6-9a1a4a3fa637 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:04.058570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b9df4-d2fa-48ff-91a6-9a1a4a3fa637 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:04.058753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 400/797] 10.222.0.46 () {56 vars in 1129 bytes} [Tue Jun 21 15:45:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:04.059632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb92c8-b84f-411d-a601-4df66f72e188 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-6f3b9df4-d2fa-48ff-91a6-9a1a4a3fa637 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:04.074284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:04.075868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:04.076774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:04.076774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:04.076774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:04.076774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:04.076774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:04.076774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:04.076774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:04.076774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:04.080266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 398/798] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:04.081449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5b26-ca4e-487a-938b-04ad99d0e5c2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.081748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5b26-ca4e-487a-938b-04ad99d0e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.082044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5b26-ca4e-487a-938b-04ad99d0e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.095180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:04.101337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-02dd5b26-ca4e-487a-938b-04ad99d0e5c2 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:04.102740 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-02dd5b26-ca4e-487a-938b-04ad99d0e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:04.146520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:04.172721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb92c8-b84f-411d-a601-4df66f72e188 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:04.178552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 399/799] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:04.184535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5b26-ca4e-487a-938b-04ad99d0e5c2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:04.213356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d99295-0596-4bb8-8b19-8fe17a1519a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:04.214112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d99295-0596-4bb8-8b19-8fe17a1519a0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.214464 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d99295-0596-4bb8-8b19-8fe17a1519a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.214750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d99295-0596-4bb8-8b19-8fe17a1519a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.215535 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d99295-0596-4bb8-8b19-8fe17a1519a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:04.215844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d99295-0596-4bb8-8b19-8fe17a1519a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:04.217221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d99295-0596-4bb8-8b19-8fe17a1519a0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:04.227224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 401/800] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:45:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:04.232571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d99295-0596-4bb8-8b19-8fe17a1519a0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:04.318600 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5b26-ca4e-487a-938b-04ad99d0e5c2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:04.338021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:04.345675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d99295-0596-4bb8-8b19-8fe17a1519a0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:04.357030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbb0f3-8375-4adf-958e-8828732e7ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:04.357727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbb0f3-8375-4adf-958e-8828732e7ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.358003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbb0f3-8375-4adf-958e-8828732e7ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.358289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbb0f3-8375-4adf-958e-8828732e7ce8 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.359008 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbb0f3-8375-4adf-958e-8828732e7ce8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:04.359354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbb0f3-8375-4adf-958e-8828732e7ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:04.360736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbb0f3-8375-4adf-958e-8828732e7ce8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:04.365725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 400/801] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jun 21 15:45:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:04.371283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbb0f3-8375-4adf-958e-8828732e7ce8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:04.383501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e6aad-a846-4dcc-9a14-f9d4bf06e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:04.384177 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e6aad-a846-4dcc-9a14-f9d4bf06e5ab None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.384477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e6aad-a846-4dcc-9a14-f9d4bf06e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.384737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e6aad-a846-4dcc-9a14-f9d4bf06e5ab None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.385529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e6aad-a846-4dcc-9a14-f9d4bf06e5ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:04.385845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e6aad-a846-4dcc-9a14-f9d4bf06e5ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:04.387335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e6aad-a846-4dcc-9a14-f9d4bf06e5ab None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:04.402917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 402/802] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:04.403523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e6aad-a846-4dcc-9a14-f9d4bf06e5ab None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:04.431476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:04.503623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbb0f3-8375-4adf-958e-8828732e7ce8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:04.533331 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e6aad-a846-4dcc-9a14-f9d4bf06e5ab None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:04.549022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0365c-ef7c-4f7e-be2b-a9439a21e58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:04.550019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0365c-ef7c-4f7e-be2b-a9439a21e58f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.550304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0365c-ef7c-4f7e-be2b-a9439a21e58f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.550872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0365c-ef7c-4f7e-be2b-a9439a21e58f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.569349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0365c-ef7c-4f7e-be2b-a9439a21e58f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-51a0365c-ef7c-4f7e-be2b-a9439a21e58f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:04.580648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:04.581904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 401/803] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:04.583813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0365c-ef7c-4f7e-be2b-a9439a21e58f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:04.596234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b855-7b76-43f7-b3e5-98ad9f52664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:04.598757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b855-7b76-43f7-b3e5-98ad9f52664b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.600140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b855-7b76-43f7-b3e5-98ad9f52664b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.601490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b855-7b76-43f7-b3e5-98ad9f52664b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.617535 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2b855-7b76-43f7-b3e5-98ad9f52664b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:04.620043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2b855-7b76-43f7-b3e5-98ad9f52664b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f0f2b855-7b76-43f7-b3e5-98ad9f52664b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:04.644881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:04.646036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:04.647135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:04.647135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:04.647135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:04.647135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:04.653922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 403/804] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:04.653922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b855-7b76-43f7-b3e5-98ad9f52664b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:04.660084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:04.725960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:04.730676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0365c-ef7c-4f7e-be2b-a9439a21e58f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:04.770193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec747741-0ceb-4325-b760-0b7d18981541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:04.770877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747741-0ceb-4325-b760-0b7d18981541 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.771190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747741-0ceb-4325-b760-0b7d18981541 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.771482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747741-0ceb-4325-b760-0b7d18981541 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.772201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec747741-0ceb-4325-b760-0b7d18981541 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:04.773179 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec747741-0ceb-4325-b760-0b7d18981541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:04.774839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec747741-0ceb-4325-b760-0b7d18981541 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:04.780954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 402/805] 10.222.0.46 () {56 vars in 1124 bytes} [Tue Jun 21 15:45:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:04.781773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec747741-0ceb-4325-b760-0b7d18981541 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:04.784698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b855-7b76-43f7-b3e5-98ad9f52664b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:04.829339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb369bc-7e0f-4df6-8939-36697cb21b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:04.830345 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb369bc-7e0f-4df6-8939-36697cb21b30 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.830527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb369bc-7e0f-4df6-8939-36697cb21b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.830807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb369bc-7e0f-4df6-8939-36697cb21b30 None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/35ec9ea691c141eb86bf7a825fbb80ed/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.834107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb369bc-7e0f-4df6-8939-36697cb21b30 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=35ec9ea691c141eb86bf7a825fbb80ed, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:04.836675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb369bc-7e0f-4df6-8939-36697cb21b30 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:04.852586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 404/806] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:45:04 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/35ec9ea691c141eb86bf7a825fbb80ed/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:45:04.853450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb369bc-7e0f-4df6-8939-36697cb21b30 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:04.926446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec747741-0ceb-4325-b760-0b7d18981541 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:04.964793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:04.986411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f1fb-3b67-4016-830a-0d211b5a7d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:04.987104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f1fb-3b67-4016-830a-0d211b5a7d3b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:04.987423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f1fb-3b67-4016-830a-0d211b5a7d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:04.987712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f1fb-3b67-4016-830a-0d211b5a7d3b None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:04.988496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0f1fb-3b67-4016-830a-0d211b5a7d3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:04.988809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0f1fb-3b67-4016-830a-0d211b5a7d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:04.990437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0f1fb-3b67-4016-830a-0d211b5a7d3b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:05.006002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 403/807] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:05.008433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf732-ea23-4fd6-b6c9-ce5d2fc3d7d2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.009004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf732-ea23-4fd6-b6c9-ce5d2fc3d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.009004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf732-ea23-4fd6-b6c9-ce5d2fc3d7d2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.010758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 404/808] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:05.015187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf732-ea23-4fd6-b6c9-ce5d2fc3d7d2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:05.030927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb369bc-7e0f-4df6-8939-36697cb21b30 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:05.048249 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:05.077680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0af7a-b0a0-499a-8b80-23e70bb2bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:05.078897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0af7a-b0a0-499a-8b80-23e70bb2bad1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.079426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0af7a-b0a0-499a-8b80-23e70bb2bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.079761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0af7a-b0a0-499a-8b80-23e70bb2bad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.080517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0af7a-b0a0-499a-8b80-23e70bb2bad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:05.080836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0af7a-b0a0-499a-8b80-23e70bb2bad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:05.082260 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0af7a-b0a0-499a-8b80-23e70bb2bad1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:05.100117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 405/809] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:05.100991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0af7a-b0a0-499a-8b80-23e70bb2bad1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:05.154847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf732-ea23-4fd6-b6c9-ce5d2fc3d7d2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:05.196585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35368201-e5f5-433d-8621-9e0b67880696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:05.197156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368201-e5f5-433d-8621-9e0b67880696 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.197444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368201-e5f5-433d-8621-9e0b67880696 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.197722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368201-e5f5-433d-8621-9e0b67880696 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.198475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35368201-e5f5-433d-8621-9e0b67880696 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:05.199913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35368201-e5f5-433d-8621-9e0b67880696 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:05.224414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 405/810] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jun 21 15:45:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:05.225108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c71f4-8d35-4c30-8137-bca1627e0aab None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.225402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c71f4-8d35-4c30-8137-bca1627e0aab None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.225725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c71f4-8d35-4c30-8137-bca1627e0aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.248932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0af7a-b0a0-499a-8b80-23e70bb2bad1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:05.256226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b42c71f4-8d35-4c30-8137-bca1627e0aab None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:05.258429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b42c71f4-8d35-4c30-8137-bca1627e0aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:05.282150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:05.296524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32efc2-e15a-40a8-b555-f1a68c468ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:05.297524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32efc2-e15a-40a8-b555-f1a68c468ccc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.297915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32efc2-e15a-40a8-b555-f1a68c468ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.298319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32efc2-e15a-40a8-b555-f1a68c468ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.312408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32efc2-e15a-40a8-b555-f1a68c468ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:05.314131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32efc2-e15a-40a8-b555-f1a68c468ccc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6a32efc2-e15a-40a8-b555-f1a68c468ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:05.335451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:05.336549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:05.339276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:05.339276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:05.339276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:05.339276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:05.339276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 406/811] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:05.339276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32efc2-e15a-40a8-b555-f1a68c468ccc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:05.372351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 406/812] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:05.373598 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c71f4-8d35-4c30-8137-bca1627e0aab None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:05.401337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:05.468743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32efc2-e15a-40a8-b555-f1a68c468ccc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:05.506370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a957c-99ae-4395-be28-1c8eba1b08ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:05.508157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a957c-99ae-4395-be28-1c8eba1b08ea None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.508637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a957c-99ae-4395-be28-1c8eba1b08ea None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.509042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a957c-99ae-4395-be28-1c8eba1b08ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.517712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a957c-99ae-4395-be28-1c8eba1b08ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:05.519532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a957c-99ae-4395-be28-1c8eba1b08ea None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:05.520776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c71f4-8d35-4c30-8137-bca1627e0aab None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-105a957c-99ae-4395-be28-1c8eba1b08ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:05.536500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:05.537521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:05.538746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 407/813] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jun 21 15:45:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:05.540145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a957c-99ae-4395-be28-1c8eba1b08ea None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:05.571916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080556-8589-47f9-821a-8a39616caae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:05.572908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080556-8589-47f9-821a-8a39616caae0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.573394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080556-8589-47f9-821a-8a39616caae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.573977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1080556-8589-47f9-821a-8a39616caae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.575326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080556-8589-47f9-821a-8a39616caae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:05.575870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080556-8589-47f9-821a-8a39616caae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:05.577472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1080556-8589-47f9-821a-8a39616caae0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:05.581814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:05.595433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 407/814] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:05.596732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080556-8589-47f9-821a-8a39616caae0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:05.662289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a957c-99ae-4395-be28-1c8eba1b08ea None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:05.707562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:05.713511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677327fc-03dd-4409-955e-eeb899e77f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:05.714755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677327fc-03dd-4409-955e-eeb899e77f5e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.715272 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677327fc-03dd-4409-955e-eeb899e77f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.715782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677327fc-03dd-4409-955e-eeb899e77f5e None admin] PATH_INFO: `/v3/services/network` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.716907 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677327fc-03dd-4409-955e-eeb899e77f5e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:05.719275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677327fc-03dd-4409-955e-eeb899e77f5e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:05.723758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1080556-8589-47f9-821a-8a39616caae0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-677327fc-03dd-4409-955e-eeb899e77f5e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:05.737761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:05.738810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:45:05.739686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:05.745926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 408/815] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:05 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:05.747549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677327fc-03dd-4409-955e-eeb899e77f5e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:05.767955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4c81-25cb-43aa-8489-5402c139b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:05.768982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4c81-25cb-43aa-8489-5402c139b6ff None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.769448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4c81-25cb-43aa-8489-5402c139b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.769981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4c81-25cb-43aa-8489-5402c139b6ff None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.771068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4c81-25cb-43aa-8489-5402c139b6ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:05.771576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4c81-25cb-43aa-8489-5402c139b6ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:05.773868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4c81-25cb-43aa-8489-5402c139b6ff None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:05.794500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 408/816] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jun 21 15:45:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:05.795699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4c81-25cb-43aa-8489-5402c139b6ff None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:05.865351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:05.869826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677327fc-03dd-4409-955e-eeb899e77f5e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:05.905949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691e7d9-5002-49a6-bf9e-913dbe167bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:05.906830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691e7d9-5002-49a6-bf9e-913dbe167bae None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.907224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691e7d9-5002-49a6-bf9e-913dbe167bae None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.907587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691e7d9-5002-49a6-bf9e-913dbe167bae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.915579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4c81-25cb-43aa-8489-5402c139b6ff None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:05.915972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691e7d9-5002-49a6-bf9e-913dbe167bae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:05.917527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691e7d9-5002-49a6-bf9e-913dbe167bae None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9691e7d9-5002-49a6-bf9e-913dbe167bae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:05.932987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:05.933992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:05.934977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 409/817] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jun 21 15:45:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:05.935877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691e7d9-5002-49a6-bf9e-913dbe167bae None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:05.952183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:05.961165 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71654f-075b-4c82-9044-e38ed3e07cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:05.962251 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71654f-075b-4c82-9044-e38ed3e07cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:05.962890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71654f-075b-4c82-9044-e38ed3e07cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:05.963545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71654f-075b-4c82-9044-e38ed3e07cc3 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:05.964465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71654f-075b-4c82-9044-e38ed3e07cc3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:05.964989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71654f-075b-4c82-9044-e38ed3e07cc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:05.966892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71654f-075b-4c82-9044-e38ed3e07cc3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:05.973236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 409/818] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:05.974375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71654f-075b-4c82-9044-e38ed3e07cc3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:06.050565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691e7d9-5002-49a6-bf9e-913dbe167bae None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:06.098066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd980-534d-45c4-9f62-2f97e05aaab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:06.098915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd980-534d-45c4-9f62-2f97e05aaab0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:06.099274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd980-534d-45c4-9f62-2f97e05aaab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:06.099781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd980-534d-45c4-9f62-2f97e05aaab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:06.101434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71654f-075b-4c82-9044-e38ed3e07cc3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:06.115970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bd980-534d-45c4-9f62-2f97e05aaab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:06.118268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bd980-534d-45c4-9f62-2f97e05aaab0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3e8bd980-534d-45c4-9f62-2f97e05aaab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:06.141575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:06.142541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:06.143940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:06.143940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:06.143940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:06.143940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:06.145755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6df85-c1a2-4ddb-a62c-2406d1596b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:06.146729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6df85-c1a2-4ddb-a62c-2406d1596b7f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:06.147283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6df85-c1a2-4ddb-a62c-2406d1596b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:06.147956 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6df85-c1a2-4ddb-a62c-2406d1596b7f None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:06.149005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6df85-c1a2-4ddb-a62c-2406d1596b7f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:06.149515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6df85-c1a2-4ddb-a62c-2406d1596b7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:06.150128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 410/819] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:06.151321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd980-534d-45c4-9f62-2f97e05aaab0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:06.151753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6df85-c1a2-4ddb-a62c-2406d1596b7f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:06.170865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:06.175223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 410/820] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jun 21 15:45:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:06.176992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6df85-c1a2-4ddb-a62c-2406d1596b7f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:06.237293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:06.289654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd980-534d-45c4-9f62-2f97e05aaab0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:06.296417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6df85-c1a2-4ddb-a62c-2406d1596b7f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:06.335770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5a96-006e-462a-a1a8-a00254e314d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:06.336482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddbbbe-8f8c-45d5-b1a8-773afc5c78b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:06.336895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5a96-006e-462a-a1a8-a00254e314d3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:06.337330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5a96-006e-462a-a1a8-a00254e314d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:06.337454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddbbbe-8f8c-45d5-b1a8-773afc5c78b3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:06.337816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddbbbe-8f8c-45d5-b1a8-773afc5c78b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:06.338013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5a96-006e-462a-a1a8-a00254e314d3 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:06.338310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddbbbe-8f8c-45d5-b1a8-773afc5c78b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:06.339023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee5a96-006e-462a-a1a8-a00254e314d3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:06.339267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddbbbe-8f8c-45d5-b1a8-773afc5c78b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:06.339671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee5a96-006e-462a-a1a8-a00254e314d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:06.339782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddbbbe-8f8c-45d5-b1a8-773afc5c78b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:06.341220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddbbbe-8f8c-45d5-b1a8-773afc5c78b3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:06.341431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee5a96-006e-462a-a1a8-a00254e314d3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:06.352789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 411/821] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:06.352789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5a96-006e-462a-a1a8-a00254e314d3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:06.359531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 411/822] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:06.360529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddbbbe-8f8c-45d5-b1a8-773afc5c78b3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:06.441014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:06.472929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5a96-006e-462a-a1a8-a00254e314d3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:06.506142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddbbbe-8f8c-45d5-b1a8-773afc5c78b3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:06.515292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38b198-71de-4bb2-a482-5333392c04f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:06.515965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38b198-71de-4bb2-a482-5333392c04f8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:06.516257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38b198-71de-4bb2-a482-5333392c04f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:06.516868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38b198-71de-4bb2-a482-5333392c04f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:06.523879 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:06.567585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c94b82-5f40-46d2-b5ab-f17bb6701653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:06.569286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c94b82-5f40-46d2-b5ab-f17bb6701653 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:06.569768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c94b82-5f40-46d2-b5ab-f17bb6701653 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:06.570614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c94b82-5f40-46d2-b5ab-f17bb6701653 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:06.571629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c94b82-5f40-46d2-b5ab-f17bb6701653 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:06.573948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c94b82-5f40-46d2-b5ab-f17bb6701653 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:06.603331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 412/823] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jun 21 15:45:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:06.604705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c94b82-5f40-46d2-b5ab-f17bb6701653 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:06.612054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38b198-71de-4bb2-a482-5333392c04f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:06.613944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38b198-71de-4bb2-a482-5333392c04f8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:06.789321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c94b82-5f40-46d2-b5ab-f17bb6701653 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:06.804308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:06.834337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43949f-3f2b-4bad-b7b4-6bb43d55c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:06.835804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43949f-3f2b-4bad-b7b4-6bb43d55c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:06.836784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43949f-3f2b-4bad-b7b4-6bb43d55c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:06.837224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43949f-3f2b-4bad-b7b4-6bb43d55c0a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:06.846942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43949f-3f2b-4bad-b7b4-6bb43d55c0a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:06.848721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43949f-3f2b-4bad-b7b4-6bb43d55c0a1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:06.848860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 412/824] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:45:06.858615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38b198-71de-4bb2-a482-5333392c04f8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-ee43949f-3f2b-4bad-b7b4-6bb43d55c0a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:06.868839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:06.869967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:06.871078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:06.871078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:06.871078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:06.871078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:06.871078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:06.871078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:06.871078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:06.871078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:06.873948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 413/825] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:06.880208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43949f-3f2b-4bad-b7b4-6bb43d55c0a1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:06.935048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:07.010075 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38b198-71de-4bb2-a482-5333392c04f8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:07.043406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43949f-3f2b-4bad-b7b4-6bb43d55c0a1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:07.064103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0215b-3945-4a8a-add8-eaf17ceff37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:07.065429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0215b-3945-4a8a-add8-eaf17ceff37d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.065942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0215b-3945-4a8a-add8-eaf17ceff37d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.066408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0215b-3945-4a8a-add8-eaf17ceff37d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.079259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0215b-3945-4a8a-add8-eaf17ceff37d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:07.081232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0215b-3945-4a8a-add8-eaf17ceff37d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:07.086564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78566f4-2e3c-46ba-b22e-554d4669a2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:07.087285 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78566f4-2e3c-46ba-b22e-554d4669a2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.087581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78566f4-2e3c-46ba-b22e-554d4669a2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.087866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78566f4-2e3c-46ba-b22e-554d4669a2d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.088743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78566f4-2e3c-46ba-b22e-554d4669a2d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:07.088988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78566f4-2e3c-46ba-b22e-554d4669a2d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:07.090569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78566f4-2e3c-46ba-b22e-554d4669a2d9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6bd0215b-3945-4a8a-add8-eaf17ceff37d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:07.105424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:07.106404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:07.107341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:07.107341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:07.107341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:07.107341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:07.107563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 414/826] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:07.109701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 413/827] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:07.113998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78566f4-2e3c-46ba-b22e-554d4669a2d9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:07.115317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0215b-3945-4a8a-add8-eaf17ceff37d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:07.155234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:07.208738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:07.230718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78566f4-2e3c-46ba-b22e-554d4669a2d9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:07.251863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0215b-3945-4a8a-add8-eaf17ceff37d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:07.274641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc22ce-1eed-4e90-b264-4a71e55748d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:07.275682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc22ce-1eed-4e90-b264-4a71e55748d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.275969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc22ce-1eed-4e90-b264-4a71e55748d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.276251 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc22ce-1eed-4e90-b264-4a71e55748d4 None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/3bc3da0a04de412eb239aeb0b2e99eb3/roles/eda252044624460d8f0580e810d06eda` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.292404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291b745-d00b-4527-8f57-666f3a72c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:07.293118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b745-d00b-4527-8f57-666f3a72c9fb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.293464 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b745-d00b-4527-8f57-666f3a72c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.293694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b745-d00b-4527-8f57-666f3a72c9fb None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.294435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291b745-d00b-4527-8f57-666f3a72c9fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:07.294751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291b745-d00b-4527-8f57-666f3a72c9fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:07.295343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc22ce-1eed-4e90-b264-4a71e55748d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=3bc3da0a04de412eb239aeb0b2e99eb3, role_id=eda252044624460d8f0580e810d06eda)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:07.296193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291b745-d00b-4527-8f57-666f3a72c9fb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:07.296794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc22ce-1eed-4e90-b264-4a71e55748d4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:07.309635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 414/828] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:07.311020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247e9dc-e3d2-4e7f-8d0a-8f9083da2ab7 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.311347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247e9dc-e3d2-4e7f-8d0a-8f9083da2ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.311651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247e9dc-e3d2-4e7f-8d0a-8f9083da2ab7 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.313130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 415/829] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:07.317759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247e9dc-e3d2-4e7f-8d0a-8f9083da2ab7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:07.327551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 415/830] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:45:07 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/3bc3da0a04de412eb239aeb0b2e99eb3/roles/eda252044624460d8f0580e810d06eda => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:45:07.327551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976718-b48e-4ddf-a7df-fc5f92da91e3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.327551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976718-b48e-4ddf-a7df-fc5f92da91e3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.327551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976718-b48e-4ddf-a7df-fc5f92da91e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.352647 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-89976718-b48e-4ddf-a7df-fc5f92da91e3 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:07.354352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-89976718-b48e-4ddf-a7df-fc5f92da91e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:07.444587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:07.458642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 416/831] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:07.471092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247e9dc-e3d2-4e7f-8d0a-8f9083da2ab7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:07.483624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89976718-b48e-4ddf-a7df-fc5f92da91e3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:07.517857 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b9b5d-fdcd-40ea-87e3-fe7e9c8ea199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:07.518857 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b9b5d-fdcd-40ea-87e3-fe7e9c8ea199 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.519199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b9b5d-fdcd-40ea-87e3-fe7e9c8ea199 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.519468 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b9b5d-fdcd-40ea-87e3-fe7e9c8ea199 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.531242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b9b5d-fdcd-40ea-87e3-fe7e9c8ea199 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:07.532722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b9b5d-fdcd-40ea-87e3-fe7e9c8ea199 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5b0b9b5d-fdcd-40ea-87e3-fe7e9c8ea199 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:07.549973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:07.550875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:07.552006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:07.552006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:07.552006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:07.552006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:07.552006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:07.552006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:07.552006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:07.552006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:07.552006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 416/832] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:07.557145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b9b5d-fdcd-40ea-87e3-fe7e9c8ea199 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:07.566854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:07.615375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89976718-b48e-4ddf-a7df-fc5f92da91e3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:07.661377 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f2396-7238-47ff-b17f-aa4fd5922a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:07.662184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f2396-7238-47ff-b17f-aa4fd5922a56 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.662473 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f2396-7238-47ff-b17f-aa4fd5922a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.662756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f2396-7238-47ff-b17f-aa4fd5922a56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.675405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f2396-7238-47ff-b17f-aa4fd5922a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:07.682941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b9b5d-fdcd-40ea-87e3-fe7e9c8ea199 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e63f2396-7238-47ff-b17f-aa4fd5922a56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:07.684133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:07.685205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:07.686235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 417/833] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:07.687236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ed67a-24a2-4930-b9b8-b8a7cb1dd721 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.687236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ed67a-24a2-4930-b9b8-b8a7cb1dd721 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.687236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ed67a-24a2-4930-b9b8-b8a7cb1dd721 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.688794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 418/834] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:07.691475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ed67a-24a2-4930-b9b8-b8a7cb1dd721 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:07.732795 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d6370-fb8e-4959-a573-42585077cdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:07.733469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d6370-fb8e-4959-a573-42585077cdfb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.733780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d6370-fb8e-4959-a573-42585077cdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.734317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d6370-fb8e-4959-a573-42585077cdfb None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.734885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d6370-fb8e-4959-a573-42585077cdfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:07.735185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d6370-fb8e-4959-a573-42585077cdfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:07.736622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d6370-fb8e-4959-a573-42585077cdfb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:07.754883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 417/835] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:07.754883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b56b44-97f0-41a7-a8da-6f06b808a5c2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.754883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b56b44-97f0-41a7-a8da-6f06b808a5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.754883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b56b44-97f0-41a7-a8da-6f06b808a5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.765836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:07.771896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d6b56b44-97f0-41a7-a8da-6f06b808a5c2 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:07.773254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d6b56b44-97f0-41a7-a8da-6f06b808a5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:07.822260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ed67a-24a2-4930-b9b8-b8a7cb1dd721 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:07.849583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:07.852594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 418/836] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:07.853701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b56b44-97f0-41a7-a8da-6f06b808a5c2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:07.873404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660898f-a64b-47d2-a442-f8cafe7e8868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:07.874443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660898f-a64b-47d2-a442-f8cafe7e8868 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:07.874804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660898f-a64b-47d2-a442-f8cafe7e8868 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:07.875205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660898f-a64b-47d2-a442-f8cafe7e8868 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:07.876233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660898f-a64b-47d2-a442-f8cafe7e8868 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:07.876551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660898f-a64b-47d2-a442-f8cafe7e8868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:07.878286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660898f-a64b-47d2-a442-f8cafe7e8868 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:07.889912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 419/837] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:07.889912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660898f-a64b-47d2-a442-f8cafe7e8868 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:07.974424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b56b44-97f0-41a7-a8da-6f06b808a5c2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:08.010692 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660898f-a64b-47d2-a442-f8cafe7e8868 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:08.014849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7343d77-3121-42ed-a969-4756218d0bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:08.015555 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7343d77-3121-42ed-a969-4756218d0bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:08.015847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7343d77-3121-42ed-a969-4756218d0bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:08.016130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7343d77-3121-42ed-a969-4756218d0bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:08.016973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7343d77-3121-42ed-a969-4756218d0bf0 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2ab989a935eb4d91a94611cededd3cf6) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:08.017289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7343d77-3121-42ed-a969-4756218d0bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:08.018731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7343d77-3121-42ed-a969-4756218d0bf0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:08.021817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:08.027332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 419/838] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:07 2022] GET /identity/v3/role_assignments?user.id=2ab989a935eb4d91a94611cededd3cf6&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=29dae918965d40bea71d83ffa2085316 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:08.037199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7343d77-3121-42ed-a969-4756218d0bf0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:08.055640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356475d-1c72-43b5-9074-6eec47992579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:08.056963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356475d-1c72-43b5-9074-6eec47992579 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:08.057518 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356475d-1c72-43b5-9074-6eec47992579 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:08.058046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356475d-1c72-43b5-9074-6eec47992579 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:08.058989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356475d-1c72-43b5-9074-6eec47992579 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:08.060761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356475d-1c72-43b5-9074-6eec47992579 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-3356475d-1c72-43b5-9074-6eec47992579 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:08.080661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:08.081709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:08.088642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 420/839] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:45:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:08.091200 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356475d-1c72-43b5-9074-6eec47992579 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:08.153343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:08.195807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7343d77-3121-42ed-a969-4756218d0bf0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:08.223882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356475d-1c72-43b5-9074-6eec47992579 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:08.242874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e313c7-7ddf-4e67-84da-1673142c62a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:08.243394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e313c7-7ddf-4e67-84da-1673142c62a7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:08.243682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e313c7-7ddf-4e67-84da-1673142c62a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:08.243964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e313c7-7ddf-4e67-84da-1673142c62a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:08.266927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae77b-dcca-42bf-b9ef-de6c59cd596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:08.267780 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae77b-dcca-42bf-b9ef-de6c59cd596c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:08.268149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae77b-dcca-42bf-b9ef-de6c59cd596c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:08.268438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae77b-dcca-42bf-b9ef-de6c59cd596c None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:08.269181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ae77b-dcca-42bf-b9ef-de6c59cd596c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:08.269503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ae77b-dcca-42bf-b9ef-de6c59cd596c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:08.270935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ae77b-dcca-42bf-b9ef-de6c59cd596c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:08.277496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 421/840] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:45:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:08.283797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae77b-dcca-42bf-b9ef-de6c59cd596c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:08.383623 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e313c7-7ddf-4e67-84da-1673142c62a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:08.385040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e313c7-7ddf-4e67-84da-1673142c62a7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-73e313c7-7ddf-4e67-84da-1673142c62a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:08.406050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:08.406997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:08.408034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:08.408034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:08.408034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:08.408034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:08.408277 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae77b-dcca-42bf-b9ef-de6c59cd596c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:08.408355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 420/841] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:08.413742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e313c7-7ddf-4e67-84da-1673142c62a7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:08.426925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:08.463661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68a1b7-6a2b-4886-bf33-06aaadf73d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:08.464342 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68a1b7-6a2b-4886-bf33-06aaadf73d2c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:08.464654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68a1b7-6a2b-4886-bf33-06aaadf73d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:08.464931 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68a1b7-6a2b-4886-bf33-06aaadf73d2c None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:08.465650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68a1b7-6a2b-4886-bf33-06aaadf73d2c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:08.465960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68a1b7-6a2b-4886-bf33-06aaadf73d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:08.467516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68a1b7-6a2b-4886-bf33-06aaadf73d2c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:08.479192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 422/842] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:45:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:08.481627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:08.547693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e313c7-7ddf-4e67-84da-1673142c62a7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:08.590173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e59221-840e-45f1-808a-7fa75f4879c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:08.590853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e59221-840e-45f1-808a-7fa75f4879c7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:08.591134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e59221-840e-45f1-808a-7fa75f4879c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:08.591438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e59221-840e-45f1-808a-7fa75f4879c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:08.592241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e59221-840e-45f1-808a-7fa75f4879c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:08.592549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e59221-840e-45f1-808a-7fa75f4879c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:08.594004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e59221-840e-45f1-808a-7fa75f4879c7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:08.608547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 421/843] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:08.616395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68a1b7-6a2b-4886-bf33-06aaadf73d2c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:08.735378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68a1b7-6a2b-4886-bf33-06aaadf73d2c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:08.775247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f16df-99e2-45bf-95ca-ddf8f12a3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:08.776058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f16df-99e2-45bf-95ca-ddf8f12a3655 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:08.776349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f16df-99e2-45bf-95ca-ddf8f12a3655 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:08.776638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f16df-99e2-45bf-95ca-ddf8f12a3655 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:08.785104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f16df-99e2-45bf-95ca-ddf8f12a3655 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:08.786568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f16df-99e2-45bf-95ca-ddf8f12a3655 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-8a8f16df-99e2-45bf-95ca-ddf8f12a3655 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:08.802866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:08.804052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:08.805019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:08.805019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:08.805019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:08.805019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:08.805019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:08.805019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:08.805019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:08.805019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:08.805019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:45:08.805019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:08.805563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 423/844] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:45:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:08.810585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e59221-840e-45f1-808a-7fa75f4879c7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:08.927484 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e59221-840e-45f1-808a-7fa75f4879c7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:08.944392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:08.967856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f016cd-5291-4998-a24c-d05f8ae81e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:08.968788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f016cd-5291-4998-a24c-d05f8ae81e82 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:08.969079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f016cd-5291-4998-a24c-d05f8ae81e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:08.969360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f016cd-5291-4998-a24c-d05f8ae81e82 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:08.970270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f016cd-5291-4998-a24c-d05f8ae81e82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:08.970701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f016cd-5291-4998-a24c-d05f8ae81e82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:08.972402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f016cd-5291-4998-a24c-d05f8ae81e82 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:08.991909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 422/845] 10.222.0.46 () {56 vars in 1135 bytes} [Tue Jun 21 15:45:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:08.997680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f16df-99e2-45bf-95ca-ddf8f12a3655 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:09.041982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:09.113738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f16df-99e2-45bf-95ca-ddf8f12a3655 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:09.150805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a173c-cb0e-4a84-b254-72f85e0056cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:09.151797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a173c-cb0e-4a84-b254-72f85e0056cd None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:09.152270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a173c-cb0e-4a84-b254-72f85e0056cd None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:09.152728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a173c-cb0e-4a84-b254-72f85e0056cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:09.230965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a173c-cb0e-4a84-b254-72f85e0056cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:09.232747 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a173c-cb0e-4a84-b254-72f85e0056cd None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:09.273806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:09.345717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 424/846] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:45:09.352025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f016cd-5291-4998-a24c-d05f8ae81e82 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:09.463377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f016cd-5291-4998-a24c-d05f8ae81e82 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:09.499340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7346-623d-424f-9d02-6ea406bf2604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:09.500137 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7346-623d-424f-9d02-6ea406bf2604 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:09.500424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7346-623d-424f-9d02-6ea406bf2604 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:09.500699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7346-623d-424f-9d02-6ea406bf2604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:09.512475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7346-623d-424f-9d02-6ea406bf2604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:09.515286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7346-623d-424f-9d02-6ea406bf2604 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:09.519051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f90a8-4f0b-44da-a826-1836e6841cbc None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:09.519513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f90a8-4f0b-44da-a826-1836e6841cbc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:09.519908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f90a8-4f0b-44da-a826-1836e6841cbc None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:09.524416 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 425/847] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:09.530678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870619f-6ddb-4f55-80bd-e835408827ab None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:09.530977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870619f-6ddb-4f55-80bd-e835408827ab None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:09.531301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870619f-6ddb-4f55-80bd-e835408827ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-047c7346-623d-424f-9d02-6ea406bf2604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:09.539486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:09.540506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:09.541500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:09.541500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:09.541500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:09.541500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:09.543350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 423/848] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:09.548258 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7346-623d-424f-9d02-6ea406bf2604 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:09.552790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3870619f-6ddb-4f55-80bd-e835408827ab None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:09.554253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3870619f-6ddb-4f55-80bd-e835408827ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:09.590139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:09.647719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 426/849] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:09.666917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870619f-6ddb-4f55-80bd-e835408827ab None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:09.698796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7346-623d-424f-9d02-6ea406bf2604 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:09.739475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1e055-0434-4d7b-837d-de458ff69b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:09.740561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1e055-0434-4d7b-837d-de458ff69b3e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:09.741178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1e055-0434-4d7b-837d-de458ff69b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:09.741723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1e055-0434-4d7b-837d-de458ff69b3e None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:09.742787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1e055-0434-4d7b-837d-de458ff69b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:09.743407 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1e055-0434-4d7b-837d-de458ff69b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:09.745231 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1e055-0434-4d7b-837d-de458ff69b3e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:09.750513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:09.763868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 424/850] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:09.770037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1e055-0434-4d7b-837d-de458ff69b3e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:09.800854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870619f-6ddb-4f55-80bd-e835408827ab None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:09.849330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f7cd0-0e89-4d35-85d1-2d5876f030a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:09.850196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f7cd0-0e89-4d35-85d1-2d5876f030a8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:09.850587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f7cd0-0e89-4d35-85d1-2d5876f030a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:09.850865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f7cd0-0e89-4d35-85d1-2d5876f030a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:09.861563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:09.864941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f7cd0-0e89-4d35-85d1-2d5876f030a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-dd7f7cd0-0e89-4d35-85d1-2d5876f030a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:09.875466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:09.876419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:45:09.877274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:09.882622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 427/851] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:45:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:09.883776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f7cd0-0e89-4d35-85d1-2d5876f030a8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:09.894923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1e055-0434-4d7b-837d-de458ff69b3e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:09.958050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341d9e-0c5b-4e47-b35b-0d2f752c5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:09.959347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341d9e-0c5b-4e47-b35b-0d2f752c5736 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:09.959926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341d9e-0c5b-4e47-b35b-0d2f752c5736 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:09.960468 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341d9e-0c5b-4e47-b35b-0d2f752c5736 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:09.968218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a341d9e-0c5b-4e47-b35b-0d2f752c5736 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:09.969982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a341d9e-0c5b-4e47-b35b-0d2f752c5736 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3a341d9e-0c5b-4e47-b35b-0d2f752c5736 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:09.985243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:09.986169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:09.987055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:09.987055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:09.987055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:09.987055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:09.987055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:09.987055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:09.987055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:09.987055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:09.989729 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 425/852] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:09.998674 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341d9e-0c5b-4e47-b35b-0d2f752c5736 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:10.027303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f7cd0-0e89-4d35-85d1-2d5876f030a8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:10.063229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:10.077928 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841159-dca6-4f22-a346-dc9d0e3921d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:10.078608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841159-dca6-4f22-a346-dc9d0e3921d3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.078898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841159-dca6-4f22-a346-dc9d0e3921d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.079193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841159-dca6-4f22-a346-dc9d0e3921d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.079965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c841159-dca6-4f22-a346-dc9d0e3921d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:10.080281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c841159-dca6-4f22-a346-dc9d0e3921d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:10.081663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c841159-dca6-4f22-a346-dc9d0e3921d3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:10.095051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 428/853] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:45:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:10.096161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841159-dca6-4f22-a346-dc9d0e3921d3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:10.120023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341d9e-0c5b-4e47-b35b-0d2f752c5736 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:10.157219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616039a-5b72-48bd-877a-9e1d12d50dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:10.157892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616039a-5b72-48bd-877a-9e1d12d50dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.158184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616039a-5b72-48bd-877a-9e1d12d50dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.158469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616039a-5b72-48bd-877a-9e1d12d50dc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.159316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616039a-5b72-48bd-877a-9e1d12d50dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:10.159635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616039a-5b72-48bd-877a-9e1d12d50dc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:10.161500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616039a-5b72-48bd-877a-9e1d12d50dc4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:10.181357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 426/854] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:10.190213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616039a-5b72-48bd-877a-9e1d12d50dc4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:10.201695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:10.228099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841159-dca6-4f22-a346-dc9d0e3921d3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:10.268621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cdeaa-c219-4658-a4bd-66f2465be9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:10.269498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cdeaa-c219-4658-a4bd-66f2465be9be None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.269903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cdeaa-c219-4658-a4bd-66f2465be9be None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.270193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cdeaa-c219-4658-a4bd-66f2465be9be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.286038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cdeaa-c219-4658-a4bd-66f2465be9be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:10.289077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cdeaa-c219-4658-a4bd-66f2465be9be None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-479cdeaa-c219-4658-a4bd-66f2465be9be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:10.313848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:10.314772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:10.315682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:10.315682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:10.315682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:10.315682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:10.320244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 429/855] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:10.322278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cdeaa-c219-4658-a4bd-66f2465be9be None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:10.329004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616039a-5b72-48bd-877a-9e1d12d50dc4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:10.367114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ff62d-7cf5-4739-aefa-f3bc3b65ffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:10.367804 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ff62d-7cf5-4739-aefa-f3bc3b65ffed None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.368088 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ff62d-7cf5-4739-aefa-f3bc3b65ffed None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.368359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ff62d-7cf5-4739-aefa-f3bc3b65ffed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.369197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ff62d-7cf5-4739-aefa-f3bc3b65ffed None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=35ec9ea691c141eb86bf7a825fbb80ed) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:10.369508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ff62d-7cf5-4739-aefa-f3bc3b65ffed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:10.370931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ff62d-7cf5-4739-aefa-f3bc3b65ffed None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:10.372567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:10.377813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 427/856] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:10 2022] GET /identity/v3/role_assignments?user.id=35ec9ea691c141eb86bf7a825fbb80ed&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=29dae918965d40bea71d83ffa2085316 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:10.378902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd864d0-16d1-456f-a584-fdf3632806ca None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.379207 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd864d0-16d1-456f-a584-fdf3632806ca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.379487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd864d0-16d1-456f-a584-fdf3632806ca None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.385305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 428/857] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:10.387564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6d793-4a3a-4e08-afcc-a6985e82090c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.387856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6d793-4a3a-4e08-afcc-a6985e82090c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.388132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6d793-4a3a-4e08-afcc-a6985e82090c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.407695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-46c6d793-4a3a-4e08-afcc-a6985e82090c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:10.408640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-46c6d793-4a3a-4e08-afcc-a6985e82090c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:10.481716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:10.487516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cdeaa-c219-4658-a4bd-66f2465be9be None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:10.499627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 429/858] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:10.515266 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6d793-4a3a-4e08-afcc-a6985e82090c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:10.535236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55172e91-f447-48aa-9477-3fcc1f5021af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:10.536265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55172e91-f447-48aa-9477-3fcc1f5021af None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.536741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55172e91-f447-48aa-9477-3fcc1f5021af None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.537207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55172e91-f447-48aa-9477-3fcc1f5021af None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.539210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55172e91-f447-48aa-9477-3fcc1f5021af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:10.539748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55172e91-f447-48aa-9477-3fcc1f5021af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:10.541888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55172e91-f447-48aa-9477-3fcc1f5021af None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:10.560648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 430/859] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:10.564950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55172e91-f447-48aa-9477-3fcc1f5021af None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:10.645128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6d793-4a3a-4e08-afcc-a6985e82090c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:10.690376 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581c1c-742f-4568-87d4-1809859e98d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:10.691876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581c1c-742f-4568-87d4-1809859e98d2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.692451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581c1c-742f-4568-87d4-1809859e98d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.692849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581c1c-742f-4568-87d4-1809859e98d2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.693056 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:10.693522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581c1c-742f-4568-87d4-1809859e98d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:10.695193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581c1c-742f-4568-87d4-1809859e98d2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:10.696168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55172e91-f447-48aa-9477-3fcc1f5021af None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-23581c1c-742f-4568-87d4-1809859e98d2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:10.711650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:10.712809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:10.713641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 430/860] 10.222.0.46 () {56 vars in 1132 bytes} [Tue Jun 21 15:45:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:10.719517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581c1c-742f-4568-87d4-1809859e98d2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:10.792609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:10.846988 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581c1c-742f-4568-87d4-1809859e98d2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:10.861737 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34c21f-5af9-43ba-935f-4d04ab27f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:10.862601 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34c21f-5af9-43ba-935f-4d04ab27f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.862839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34c21f-5af9-43ba-935f-4d04ab27f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.863118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34c21f-5af9-43ba-935f-4d04ab27f7c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.870912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34c21f-5af9-43ba-935f-4d04ab27f7c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:10.872406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34c21f-5af9-43ba-935f-4d04ab27f7c8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:10.884261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf95a-f237-476d-827b-b9a911d73d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:10.885176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf95a-f237-476d-827b-b9a911d73d24 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.885615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf95a-f237-476d-827b-b9a911d73d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.886040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf95a-f237-476d-827b-b9a911d73d24 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.886910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf95a-f237-476d-827b-b9a911d73d24 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:10.887491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf95a-f237-476d-827b-b9a911d73d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:10.889308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf95a-f237-476d-827b-b9a911d73d24 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-3f34c21f-5af9-43ba-935f-4d04ab27f7c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:10.889427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:10.890498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:10.891541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 431/861] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jun 21 15:45:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:10.892325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47687-3c3d-427b-8420-89623a522883 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.892616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47687-3c3d-427b-8420-89623a522883 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.892894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47687-3c3d-427b-8420-89623a522883 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.895196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 432/862] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:10.896120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b47687-3c3d-427b-8420-89623a522883 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:10.907906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 431/863] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:10.907906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ad1a1-1ef5-469f-b6e7-45e1b4c34199 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:10.907906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ad1a1-1ef5-469f-b6e7-45e1b4c34199 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:10.907906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ad1a1-1ef5-469f-b6e7-45e1b4c34199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:10.925098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-854ad1a1-1ef5-469f-b6e7-45e1b4c34199 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:10.926307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-854ad1a1-1ef5-469f-b6e7-45e1b4c34199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:11.005166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 432/864] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:11.006437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ad1a1-1ef5-469f-b6e7-45e1b4c34199 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:11.050881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b47687-3c3d-427b-8420-89623a522883 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:11.091146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:11.095970 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583375-f5c1-42f5-a5c2-bd26e56b6400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:11.097162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583375-f5c1-42f5-a5c2-bd26e56b6400 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:11.097594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583375-f5c1-42f5-a5c2-bd26e56b6400 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:11.098089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583375-f5c1-42f5-a5c2-bd26e56b6400 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:11.099574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0583375-f5c1-42f5-a5c2-bd26e56b6400 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:11.100083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0583375-f5c1-42f5-a5c2-bd26e56b6400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:11.102846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0583375-f5c1-42f5-a5c2-bd26e56b6400 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:11.123441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 433/865] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jun 21 15:45:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:11.124280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583375-f5c1-42f5-a5c2-bd26e56b6400 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:11.150483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:11.150849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ad1a1-1ef5-469f-b6e7-45e1b4c34199 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:11.196610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bc220-f076-4067-a115-73098aa994db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:11.197635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bc220-f076-4067-a115-73098aa994db None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:11.198096 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bc220-f076-4067-a115-73098aa994db None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:11.198542 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bc220-f076-4067-a115-73098aa994db None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:11.199806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bc220-f076-4067-a115-73098aa994db None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:11.200299 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bc220-f076-4067-a115-73098aa994db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:11.202606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bc220-f076-4067-a115-73098aa994db None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:11.215208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 433/866] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:11.215208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bc220-f076-4067-a115-73098aa994db None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:11.269838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583375-f5c1-42f5-a5c2-bd26e56b6400 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:11.333117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23cb04-4efd-4547-90c6-1511f76dcf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:11.333117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23cb04-4efd-4547-90c6-1511f76dcf45 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:11.333117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23cb04-4efd-4547-90c6-1511f76dcf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:11.333474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23cb04-4efd-4547-90c6-1511f76dcf45 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:11.334170 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23cb04-4efd-4547-90c6-1511f76dcf45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:11.336536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23cb04-4efd-4547-90c6-1511f76dcf45 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:11.370645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 434/867] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:45:11 2022] POST /identity/v3/services => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:11.384036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bc220-f076-4067-a115-73098aa994db None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:11.425962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:11.462145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92159620-b82f-435c-b415-4539dfa23768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:11.462145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92159620-b82f-435c-b415-4539dfa23768 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:11.462145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92159620-b82f-435c-b415-4539dfa23768 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:11.462145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92159620-b82f-435c-b415-4539dfa23768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:11.544225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92159620-b82f-435c-b415-4539dfa23768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:11.546383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92159620-b82f-435c-b415-4539dfa23768 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:11.661104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 434/868] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:11 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:45:11.667191 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23cb04-4efd-4547-90c6-1511f76dcf45 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:11.760596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:11.801613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23cb04-4efd-4547-90c6-1511f76dcf45 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:11.864867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592469f6-6eb0-4480-9c5a-91fcd9399116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:11.865669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592469f6-6eb0-4480-9c5a-91fcd9399116 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:11.866001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592469f6-6eb0-4480-9c5a-91fcd9399116 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:11.866290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592469f6-6eb0-4480-9c5a-91fcd9399116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:11.877787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592469f6-6eb0-4480-9c5a-91fcd9399116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:11.879275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592469f6-6eb0-4480-9c5a-91fcd9399116 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-592469f6-6eb0-4480-9c5a-91fcd9399116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:11.898566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:11.900090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:11.901062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:11.901062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:11.901062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:11.901062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:11.901062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 435/869] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:11.907308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92159620-b82f-435c-b415-4539dfa23768 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:11.924062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:12.019555 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92159620-b82f-435c-b415-4539dfa23768 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:12.056406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee193c-6cf0-4b49-9bd8-e01af6057509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:12.057410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee193c-6cf0-4b49-9bd8-e01af6057509 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:12.057879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee193c-6cf0-4b49-9bd8-e01af6057509 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:12.058344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee193c-6cf0-4b49-9bd8-e01af6057509 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:12.059284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee193c-6cf0-4b49-9bd8-e01af6057509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:12.059779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee193c-6cf0-4b49-9bd8-e01af6057509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:12.061340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee193c-6cf0-4b49-9bd8-e01af6057509 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:12.074624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 435/870] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:12.079911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592469f6-6eb0-4480-9c5a-91fcd9399116 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:12.196419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592469f6-6eb0-4480-9c5a-91fcd9399116 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:12.225971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:12.236842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ba72b-fece-47c1-95d3-e46d0d144b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:12.237648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ba72b-fece-47c1-95d3-e46d0d144b31 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:12.237935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ba72b-fece-47c1-95d3-e46d0d144b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:12.238214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ba72b-fece-47c1-95d3-e46d0d144b31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:12.245631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ba72b-fece-47c1-95d3-e46d0d144b31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:12.247086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ba72b-fece-47c1-95d3-e46d0d144b31 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-0f7ba72b-fece-47c1-95d3-e46d0d144b31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:12.263415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:12.264594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:12.265885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:12.265885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:12.265885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:12.265885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:12.265885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:12.265885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:12.265885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:12.265885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:12.265885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 436/871] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:12.270889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee193c-6cf0-4b49-9bd8-e01af6057509 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:12.349057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:12.374937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee193c-6cf0-4b49-9bd8-e01af6057509 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:12.410757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911b9d2-f78a-4dbe-812e-ee0d1461cc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:12.411458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911b9d2-f78a-4dbe-812e-ee0d1461cc2a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:12.411745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911b9d2-f78a-4dbe-812e-ee0d1461cc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:12.412023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911b9d2-f78a-4dbe-812e-ee0d1461cc2a None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:12.413335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911b9d2-f78a-4dbe-812e-ee0d1461cc2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:12.413691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911b9d2-f78a-4dbe-812e-ee0d1461cc2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:12.415130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911b9d2-f78a-4dbe-812e-ee0d1461cc2a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:12.427785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 436/872] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:12.434378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ba72b-fece-47c1-95d3-e46d0d144b31 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:12.540724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ba72b-fece-47c1-95d3-e46d0d144b31 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:12.577810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55da82-c1ba-4e50-bdca-54249971ba09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:12.578609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55da82-c1ba-4e50-bdca-54249971ba09 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:12.578980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55da82-c1ba-4e50-bdca-54249971ba09 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:12.579388 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55da82-c1ba-4e50-bdca-54249971ba09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:12.580343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55da82-c1ba-4e50-bdca-54249971ba09 None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=3bc3da0a04de412eb239aeb0b2e99eb3) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:12.580679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55da82-c1ba-4e50-bdca-54249971ba09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:12.582352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55da82-c1ba-4e50-bdca-54249971ba09 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:12.590920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 437/873] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:12 2022] GET /identity/v3/role_assignments?user.id=3bc3da0a04de412eb239aeb0b2e99eb3&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:12.675263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86bc2-b4f7-4a63-9c8f-6f1e252fc44e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:12.675806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86bc2-b4f7-4a63-9c8f-6f1e252fc44e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:12.675806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e86bc2-b4f7-4a63-9c8f-6f1e252fc44e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:12.677579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 437/874] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:12.683539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fdffe-f7dd-46ac-9b4b-7d38b481bdf3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:12.683880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fdffe-f7dd-46ac-9b4b-7d38b481bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:12.684115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fdffe-f7dd-46ac-9b4b-7d38b481bdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:12.702910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fc6fdffe-f7dd-46ac-9b4b-7d38b481bdf3 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:12.704183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fc6fdffe-f7dd-46ac-9b4b-7d38b481bdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:12.767216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:12.787299 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 438/875] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:12.810258 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e86bc2-b4f7-4a63-9c8f-6f1e252fc44e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:12.925940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e86bc2-b4f7-4a63-9c8f-6f1e252fc44e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:12.963529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd851042-2b7b-49a5-a231-ccd0ecd3a82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:12.964620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851042-2b7b-49a5-a231-ccd0ecd3a82a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:12.965065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851042-2b7b-49a5-a231-ccd0ecd3a82a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:12.965495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd851042-2b7b-49a5-a231-ccd0ecd3a82a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:12.966367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd851042-2b7b-49a5-a231-ccd0ecd3a82a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:12.967947 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd851042-2b7b-49a5-a231-ccd0ecd3a82a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:12.969973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fd851042-2b7b-49a5-a231-ccd0ecd3a82a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:12.983909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:12.985942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:12.986885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 438/876] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:12.991414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fdffe-f7dd-46ac-9b4b-7d38b481bdf3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:13.100118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fdffe-f7dd-46ac-9b4b-7d38b481bdf3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:13.138883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cea742-36ef-43f7-bdf5-84f2d33405b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:13.139588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cea742-36ef-43f7-bdf5-84f2d33405b5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:13.139877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cea742-36ef-43f7-bdf5-84f2d33405b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:13.140161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cea742-36ef-43f7-bdf5-84f2d33405b5 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:13.140872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cea742-36ef-43f7-bdf5-84f2d33405b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:13.141183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cea742-36ef-43f7-bdf5-84f2d33405b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:13.142554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cea742-36ef-43f7-bdf5-84f2d33405b5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:13.148539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 439/877] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jun 21 15:45:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:13.153742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd851042-2b7b-49a5-a231-ccd0ecd3a82a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:13.261662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd851042-2b7b-49a5-a231-ccd0ecd3a82a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:13.300648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa17b8c-989a-4d2c-87e2-d94124b31ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:13.301750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17b8c-989a-4d2c-87e2-d94124b31ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:13.302273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17b8c-989a-4d2c-87e2-d94124b31ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:13.302808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17b8c-989a-4d2c-87e2-d94124b31ee8 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:13.304520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa17b8c-989a-4d2c-87e2-d94124b31ee8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:13.305261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa17b8c-989a-4d2c-87e2-d94124b31ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:13.307062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa17b8c-989a-4d2c-87e2-d94124b31ee8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:13.313192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 439/878] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jun 21 15:45:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:13.608023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23cad-fbc8-4596-9745-6bdfa2d61e03 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:13.608544 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23cad-fbc8-4596-9745-6bdfa2d61e03 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:13.608648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23cad-fbc8-4596-9745-6bdfa2d61e03 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:13.610212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 440/879] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:13.615537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60c60e-c2ad-4037-bb0b-c83b23efae02 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:13.616383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60c60e-c2ad-4037-bb0b-c83b23efae02 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:13.616688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60c60e-c2ad-4037-bb0b-c83b23efae02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:13.639704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8c60c60e-c2ad-4037-bb0b-c83b23efae02 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:13.641385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8c60c60e-c2ad-4037-bb0b-c83b23efae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:13.714371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:13.727945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 440/880] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:13 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:13.746691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b3f6-616a-4680-bebb-b5711978711e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:13.747020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b3f6-616a-4680-bebb-b5711978711e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:13.747298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b3f6-616a-4680-bebb-b5711978711e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:13.748927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 441/881] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:13.752598 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60c60e-c2ad-4037-bb0b-c83b23efae02 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:13.753866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73179fa7-f1ba-4cfc-a961-9682ca8eb70c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:13.754159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73179fa7-f1ba-4cfc-a961-9682ca8eb70c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:13.754444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73179fa7-f1ba-4cfc-a961-9682ca8eb70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:13.772333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-73179fa7-f1ba-4cfc-a961-9682ca8eb70c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:13.773725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-73179fa7-f1ba-4cfc-a961-9682ca8eb70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:13.826891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:13.858681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 442/882] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:13 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:13.877148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60c60e-c2ad-4037-bb0b-c83b23efae02 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:13.882307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73179fa7-f1ba-4cfc-a961-9682ca8eb70c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:13.923992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae88c8-e3a3-41f5-b190-f8a79a6de434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:13.924949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae88c8-e3a3-41f5-b190-f8a79a6de434 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:13.925898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae88c8-e3a3-41f5-b190-f8a79a6de434 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:13.926336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae88c8-e3a3-41f5-b190-f8a79a6de434 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:13.927240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae88c8-e3a3-41f5-b190-f8a79a6de434 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:13.929949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae88c8-e3a3-41f5-b190-f8a79a6de434 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:13.948590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 441/883] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:45:13 2022] POST /identity/v3/services => generated 269 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:14.015258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73179fa7-f1ba-4cfc-a961-9682ca8eb70c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:14.066546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1830f-f591-439c-bdf4-50856a6e27e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:14.067391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1830f-f591-439c-bdf4-50856a6e27e9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:14.067677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1830f-f591-439c-bdf4-50856a6e27e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:14.067952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1830f-f591-439c-bdf4-50856a6e27e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:14.068680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1830f-f591-439c-bdf4-50856a6e27e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:14.070268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1830f-f591-439c-bdf4-50856a6e27e9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-0eb1830f-f591-439c-bdf4-50856a6e27e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:14.083575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:14.085176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:14.086693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 443/884] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:45:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:14.094384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae88c8-e3a3-41f5-b190-f8a79a6de434 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:14.165807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:14.219779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae88c8-e3a3-41f5-b190-f8a79a6de434 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:14.255438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4805d-ced6-4619-b25d-e374929ceb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:14.256108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4805d-ced6-4619-b25d-e374929ceb4e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:14.256428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4805d-ced6-4619-b25d-e374929ceb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:14.257200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4805d-ced6-4619-b25d-e374929ceb4e None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:14.257919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4805d-ced6-4619-b25d-e374929ceb4e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:14.258228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4805d-ced6-4619-b25d-e374929ceb4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:14.259645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4805d-ced6-4619-b25d-e374929ceb4e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:14.265035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 442/885] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:45:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:14.270699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1830f-f591-439c-bdf4-50856a6e27e9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:14.313528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:14.381359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1830f-f591-439c-bdf4-50856a6e27e9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:14.419585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cac393-a59e-4723-8f34-5b7f7d846041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:14.420178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac393-a59e-4723-8f34-5b7f7d846041 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:14.420467 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac393-a59e-4723-8f34-5b7f7d846041 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:14.420749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac393-a59e-4723-8f34-5b7f7d846041 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:14.421472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cac393-a59e-4723-8f34-5b7f7d846041 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:14.421840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cac393-a59e-4723-8f34-5b7f7d846041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:14.423257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cac393-a59e-4723-8f34-5b7f7d846041 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:14.429241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 444/886] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:45:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:14.434859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4805d-ced6-4619-b25d-e374929ceb4e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:14.568488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4805d-ced6-4619-b25d-e374929ceb4e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:14.587265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:14.608283 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16e334-0e2f-48b7-85de-d640178e252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:14.609320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16e334-0e2f-48b7-85de-d640178e252b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:14.609807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16e334-0e2f-48b7-85de-d640178e252b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:14.610370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16e334-0e2f-48b7-85de-d640178e252b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:14.611493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16e334-0e2f-48b7-85de-d640178e252b None admin] RBAC: Adding query filter params (interface=public, service_id=d60a197cb34d4a4f8ee16044896f8602, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:14.612016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16e334-0e2f-48b7-85de-d640178e252b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:14.613683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16e334-0e2f-48b7-85de-d640178e252b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:14.622572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 443/887] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jun 21 15:45:14 2022] GET /identity/v3/endpoints?service_id=d60a197cb34d4a4f8ee16044896f8602&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:14.631228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cac393-a59e-4723-8f34-5b7f7d846041 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:14.742296 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cac393-a59e-4723-8f34-5b7f7d846041 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:14.743826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:14.780025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554de9f-4706-4a89-8ccc-7de0c4966090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:14.780700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554de9f-4706-4a89-8ccc-7de0c4966090 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:14.781020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554de9f-4706-4a89-8ccc-7de0c4966090 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:14.781268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554de9f-4706-4a89-8ccc-7de0c4966090 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:14.782097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554de9f-4706-4a89-8ccc-7de0c4966090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:14.783464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554de9f-4706-4a89-8ccc-7de0c4966090 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:14.789920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 445/888] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jun 21 15:45:14 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:45:15.104384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f74fe-6a02-4193-8d0b-a2a44f37563e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:15.104878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f74fe-6a02-4193-8d0b-a2a44f37563e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:15.104878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f74fe-6a02-4193-8d0b-a2a44f37563e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:15.106552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 444/889] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:15.112089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b8354-46d7-4432-8a92-d81da542bb66 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:15.112384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b8354-46d7-4432-8a92-d81da542bb66 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:15.112666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b8354-46d7-4432-8a92-d81da542bb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:15.130580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1f3b8354-46d7-4432-8a92-d81da542bb66 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:15.132673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1f3b8354-46d7-4432-8a92-d81da542bb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:15.205088 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 446/890] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:15.229749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f74fe-6a02-4193-8d0b-a2a44f37563e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:15.336935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f74fe-6a02-4193-8d0b-a2a44f37563e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:15.373672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ba46f-b017-49bb-8af0-469d79401d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:15.374473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba46f-b017-49bb-8af0-469d79401d2c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:15.374757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba46f-b017-49bb-8af0-469d79401d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:15.375100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ba46f-b017-49bb-8af0-469d79401d2c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:15.386605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ba46f-b017-49bb-8af0-469d79401d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3b7ba46f-b017-49bb-8af0-469d79401d2c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:15.395271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:15.396208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:15.397095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 445/891] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jun 21 15:45:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:15.402481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b8354-46d7-4432-8a92-d81da542bb66 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:15.501292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:15.507996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b8354-46d7-4432-8a92-d81da542bb66 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:15.531495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf007e-cd99-4ea5-9b48-f1b704ea1da4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:15.531814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf007e-cd99-4ea5-9b48-f1b704ea1da4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:15.532162 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf007e-cd99-4ea5-9b48-f1b704ea1da4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:15.533857 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 446/892] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:15.540263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd9bf-9367-4951-bceb-bff781614104 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:15.540553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd9bf-9367-4951-bceb-bff781614104 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:15.540827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd9bf-9367-4951-bceb-bff781614104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:15.544444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939cae5-30a2-407d-99ef-09fe678d0079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:15.545123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939cae5-30a2-407d-99ef-09fe678d0079 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:15.545411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939cae5-30a2-407d-99ef-09fe678d0079 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:15.545690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939cae5-30a2-407d-99ef-09fe678d0079 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:15.546445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939cae5-30a2-407d-99ef-09fe678d0079 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:15.546763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939cae5-30a2-407d-99ef-09fe678d0079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:15.548282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939cae5-30a2-407d-99ef-09fe678d0079 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:15.557508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 447/893] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jun 21 15:45:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:15.558924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e94dd9bf-9367-4951-bceb-bff781614104 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:15.560164 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e94dd9bf-9367-4951-bceb-bff781614104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:15.562946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939cae5-30a2-407d-99ef-09fe678d0079 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:15.611121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:15.647754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 447/894] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:15.664953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd9bf-9367-4951-bceb-bff781614104 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:15.669847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939cae5-30a2-407d-99ef-09fe678d0079 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:15.705171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b677d2-7e22-4d22-bddc-efef21630554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:15.705979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b677d2-7e22-4d22-bddc-efef21630554 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:15.706264 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b677d2-7e22-4d22-bddc-efef21630554 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:15.706543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b677d2-7e22-4d22-bddc-efef21630554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:15.719574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b677d2-7e22-4d22-bddc-efef21630554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:15.721032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b677d2-7e22-4d22-bddc-efef21630554 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-35b677d2-7e22-4d22-bddc-efef21630554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:15.739616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:15.740545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:15.742262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:15.742262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:15.742262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:15.742262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:15.742262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 448/895] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:15.748543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b677d2-7e22-4d22-bddc-efef21630554 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:15.761776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:15.776050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd9bf-9367-4951-bceb-bff781614104 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:15.813489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f034f-d0a7-47af-8e02-eaff6d1ecdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:15.814491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f034f-d0a7-47af-8e02-eaff6d1ecdd6 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:15.814963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f034f-d0a7-47af-8e02-eaff6d1ecdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:15.815455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f034f-d0a7-47af-8e02-eaff6d1ecdd6 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:15.816359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f034f-d0a7-47af-8e02-eaff6d1ecdd6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:15.817927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f034f-d0a7-47af-8e02-eaff6d1ecdd6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:15.843700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 448/896] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:45:15 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:15.862943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b677d2-7e22-4d22-bddc-efef21630554 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:15.909678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7bf36-4635-401d-ba7f-9b957cc1b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:15.910537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7bf36-4635-401d-ba7f-9b957cc1b526 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:15.910833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7bf36-4635-401d-ba7f-9b957cc1b526 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:15.911115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7bf36-4635-401d-ba7f-9b957cc1b526 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:15.911882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7bf36-4635-401d-ba7f-9b957cc1b526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:15.912195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7bf36-4635-401d-ba7f-9b957cc1b526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:15.914196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7bf36-4635-401d-ba7f-9b957cc1b526 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:15.929715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 449/897] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:15.935519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f034f-d0a7-47af-8e02-eaff6d1ecdd6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:15.976581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:16.064048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f034f-d0a7-47af-8e02-eaff6d1ecdd6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:16.101050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cb581-2177-4c49-8d73-cb0525ab242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:16.101934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb581-2177-4c49-8d73-cb0525ab242e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:16.102219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb581-2177-4c49-8d73-cb0525ab242e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:16.102495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb581-2177-4c49-8d73-cb0525ab242e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:16.110819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cb581-2177-4c49-8d73-cb0525ab242e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:16.112442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cb581-2177-4c49-8d73-cb0525ab242e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fb4cb581-2177-4c49-8d73-cb0525ab242e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:16.128480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:16.129505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:16.130469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 449/898] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jun 21 15:45:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:16.136398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7bf36-4635-401d-ba7f-9b957cc1b526 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:16.206780 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:16.215580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1898b7-139f-4cb0-a986-ae8e72c97c54 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:16.215877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1898b7-139f-4cb0-a986-ae8e72c97c54 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:16.216150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1898b7-139f-4cb0-a986-ae8e72c97c54 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:16.217765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 450/899] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:16.229030 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c179-8741-4710-91e2-26b40a975f97 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:16.229449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c179-8741-4710-91e2-26b40a975f97 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:16.229833 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c179-8741-4710-91e2-26b40a975f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:16.252336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-27a0c179-8741-4710-91e2-26b40a975f97 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:16.252532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7bf36-4635-401d-ba7f-9b957cc1b526 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:16.253934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-27a0c179-8741-4710-91e2-26b40a975f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:16.292329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb441114-79e8-4c5c-a6e3-a244b4caa056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:16.293576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb441114-79e8-4c5c-a6e3-a244b4caa056 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:16.294306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb441114-79e8-4c5c-a6e3-a244b4caa056 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:16.294748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb441114-79e8-4c5c-a6e3-a244b4caa056 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:16.295950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb441114-79e8-4c5c-a6e3-a244b4caa056 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:16.296717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb441114-79e8-4c5c-a6e3-a244b4caa056 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:16.298801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb441114-79e8-4c5c-a6e3-a244b4caa056 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:16.322438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 450/900] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jun 21 15:45:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:16.328055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb441114-79e8-4c5c-a6e3-a244b4caa056 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:16.345889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 451/901] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:16.371264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0c179-8741-4710-91e2-26b40a975f97 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:16.399191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:16.468743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb441114-79e8-4c5c-a6e3-a244b4caa056 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:16.500425 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0c179-8741-4710-91e2-26b40a975f97 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:16.501334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:16.515260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0409e-512a-4689-96ac-1799081831b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:16.515993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0409e-512a-4689-96ac-1799081831b1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:16.516393 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0409e-512a-4689-96ac-1799081831b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:16.516760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0409e-512a-4689-96ac-1799081831b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:16.544984 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac7421-05b9-45ba-b92f-878085264223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:16.546144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac7421-05b9-45ba-b92f-878085264223 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:16.546613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac7421-05b9-45ba-b92f-878085264223 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:16.547072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac7421-05b9-45ba-b92f-878085264223 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:16.548133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac7421-05b9-45ba-b92f-878085264223 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:16.549761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac7421-05b9-45ba-b92f-878085264223 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-71ac7421-05b9-45ba-b92f-878085264223 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:16.564087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:16.565077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:45:16.565900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:16.574740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 452/902] 10.222.0.46 () {56 vars in 1132 bytes} [Tue Jun 21 15:45:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:16.575971 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac7421-05b9-45ba-b92f-878085264223 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:16.594186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0409e-512a-4689-96ac-1799081831b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:16.595946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0409e-512a-4689-96ac-1799081831b1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:16.676596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:16.694663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac7421-05b9-45ba-b92f-878085264223 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:16.717959 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 451/903] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:16 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:45:16.719075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0409e-512a-4689-96ac-1799081831b1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:16.732927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376242a-0283-4c6c-9243-e498b9104ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:16.733922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376242a-0283-4c6c-9243-e498b9104ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:16.734426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376242a-0283-4c6c-9243-e498b9104ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:16.734914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376242a-0283-4c6c-9243-e498b9104ad6 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:16.735974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376242a-0283-4c6c-9243-e498b9104ad6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:16.736579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376242a-0283-4c6c-9243-e498b9104ad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:16.738149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376242a-0283-4c6c-9243-e498b9104ad6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:16.748478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 453/904] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:16.749653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376242a-0283-4c6c-9243-e498b9104ad6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:16.750781 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:16.834361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0409e-512a-4689-96ac-1799081831b1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:16.861099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376242a-0283-4c6c-9243-e498b9104ad6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:16.874785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e5e8-a0cc-4eb9-a6c1-3f09fe35c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:16.875616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e5e8-a0cc-4eb9-a6c1-3f09fe35c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:16.875902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e5e8-a0cc-4eb9-a6c1-3f09fe35c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:16.876184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e5e8-a0cc-4eb9-a6c1-3f09fe35c5c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:16.888368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35e5e8-a0cc-4eb9-a6c1-3f09fe35c5c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:16.890406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35e5e8-a0cc-4eb9-a6c1-3f09fe35c5c7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:16.902975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77398f1c-e9b0-4499-81fe-2af8d3540598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:16.904014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77398f1c-e9b0-4499-81fe-2af8d3540598 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:16.904524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77398f1c-e9b0-4499-81fe-2af8d3540598 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:16.905015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77398f1c-e9b0-4499-81fe-2af8d3540598 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:16.905928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77398f1c-e9b0-4499-81fe-2af8d3540598 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:16.906433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77398f1c-e9b0-4499-81fe-2af8d3540598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:16.908040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77398f1c-e9b0-4499-81fe-2af8d3540598 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9a35e5e8-a0cc-4eb9-a6c1-3f09fe35c5c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:16.912162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:16.913721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:16.914668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:16.914668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:16.914668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:16.914668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:16.914668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 452/905] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:16.923894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 454/906] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:16.924510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e5e8-a0cc-4eb9-a6c1-3f09fe35c5c7 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:16.926187 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77398f1c-e9b0-4499-81fe-2af8d3540598 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:16.944456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:17.022711 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:17.040704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77398f1c-e9b0-4499-81fe-2af8d3540598 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:17.048881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e5e8-a0cc-4eb9-a6c1-3f09fe35c5c7 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:17.078886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c3288-1985-4023-9ea8-86619141f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:17.079878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c3288-1985-4023-9ea8-86619141f39f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.080346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c3288-1985-4023-9ea8-86619141f39f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.080848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c3288-1985-4023-9ea8-86619141f39f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.081844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c3288-1985-4023-9ea8-86619141f39f None admin] RBAC: Adding query filter params (interface=public, service_id=570846ab547f418a80cb6253974bcd34, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:17.082341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c3288-1985-4023-9ea8-86619141f39f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:17.083960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c3288-1985-4023-9ea8-86619141f39f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:17.087352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42499434-c156-45b3-bc05-2f31c0f96d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:17.088044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42499434-c156-45b3-bc05-2f31c0f96d35 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.088328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42499434-c156-45b3-bc05-2f31c0f96d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.088606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42499434-c156-45b3-bc05-2f31c0f96d35 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.089370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42499434-c156-45b3-bc05-2f31c0f96d35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:17.089668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42499434-c156-45b3-bc05-2f31c0f96d35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:17.091089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42499434-c156-45b3-bc05-2f31c0f96d35 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:17.091663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 455/907] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jun 21 15:45:16 2022] GET /identity/v3/endpoints?service_id=570846ab547f418a80cb6253974bcd34&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:17.093205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b88a7-1aac-4e9e-bdee-02977d11f8a6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.093501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b88a7-1aac-4e9e-bdee-02977d11f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.093922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b88a7-1aac-4e9e-bdee-02977d11f8a6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.095373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 456/908] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:17.100351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b88a7-1aac-4e9e-bdee-02977d11f8a6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:17.109414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 453/909] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:17.110727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b8fc6-c533-4645-9223-2da44f93b609 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.111019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b8fc6-c533-4645-9223-2da44f93b609 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.111329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b8fc6-c533-4645-9223-2da44f93b609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.129913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7e8b8fc6-c533-4645-9223-2da44f93b609 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:17.131102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7e8b8fc6-c533-4645-9223-2da44f93b609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:17.192183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:17.209303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 454/910] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:17.219494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b88a7-1aac-4e9e-bdee-02977d11f8a6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:17.220068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b8fc6-c533-4645-9223-2da44f93b609 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:17.260519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847900e-1429-4536-a67c-c37b5b31c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:17.261447 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847900e-1429-4536-a67c-c37b5b31c51d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.261734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847900e-1429-4536-a67c-c37b5b31c51d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.262008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847900e-1429-4536-a67c-c37b5b31c51d None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.262687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847900e-1429-4536-a67c-c37b5b31c51d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:17.264337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847900e-1429-4536-a67c-c37b5b31c51d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:17.279275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 457/911] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jun 21 15:45:17 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:45:17.279275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847900e-1429-4536-a67c-c37b5b31c51d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:17.314360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:17.365202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b8fc6-c533-4645-9223-2da44f93b609 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:17.397991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847900e-1429-4536-a67c-c37b5b31c51d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:17.414327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9ea46-95c9-457f-804d-9b6aa9682fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:17.415501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9ea46-95c9-457f-804d-9b6aa9682fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.415974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9ea46-95c9-457f-804d-9b6aa9682fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.416570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9ea46-95c9-457f-804d-9b6aa9682fe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.425208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9ea46-95c9-457f-804d-9b6aa9682fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:17.427129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9ea46-95c9-457f-804d-9b6aa9682fe9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:17.436650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c34433-7c21-4ac9-afc3-4c6e627cf260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:17.437463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c34433-7c21-4ac9-afc3-4c6e627cf260 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.437751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c34433-7c21-4ac9-afc3-4c6e627cf260 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.438035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c34433-7c21-4ac9-afc3-4c6e627cf260 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.438704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c34433-7c21-4ac9-afc3-4c6e627cf260 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:17.440130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c34433-7c21-4ac9-afc3-4c6e627cf260 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-6cb9ea46-95c9-457f-804d-9b6aa9682fe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:17.448415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:17.449852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:17.450798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:17.450798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:17.450798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:17.450798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:17.450798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:17.450798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:17.450798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:17.450798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-22c34433-7c21-4ac9-afc3-4c6e627cf260 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:17.459146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:17.461463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:17.462298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 458/912] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:45:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:17.463087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c34433-7c21-4ac9-afc3-4c6e627cf260 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:17.463578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 455/913] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:17.467117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:17.468310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9ea46-95c9-457f-804d-9b6aa9682fe9 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:17.591455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c34433-7c21-4ac9-afc3-4c6e627cf260 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:17.596913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9ea46-95c9-457f-804d-9b6aa9682fe9 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:17.626479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:17.633224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee358-1f0c-4a1c-a3bd-be7301ac6e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:17.633913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee358-1f0c-4a1c-a3bd-be7301ac6e39 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.634223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee358-1f0c-4a1c-a3bd-be7301ac6e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.634489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee358-1f0c-4a1c-a3bd-be7301ac6e39 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.635442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ee358-1f0c-4a1c-a3bd-be7301ac6e39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:17.635765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ee358-1f0c-4a1c-a3bd-be7301ac6e39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:17.637225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ee358-1f0c-4a1c-a3bd-be7301ac6e39 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:17.640957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200cfd7-4d5a-4284-b89f-765f0c752078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:17.641890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200cfd7-4d5a-4284-b89f-765f0c752078 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.642387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200cfd7-4d5a-4284-b89f-765f0c752078 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.642882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200cfd7-4d5a-4284-b89f-765f0c752078 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.643909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200cfd7-4d5a-4284-b89f-765f0c752078 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:17.644439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200cfd7-4d5a-4284-b89f-765f0c752078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:17.646067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200cfd7-4d5a-4284-b89f-765f0c752078 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:17.656578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 459/914] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:17.658462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee358-1f0c-4a1c-a3bd-be7301ac6e39 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:17.662466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 456/915] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:45:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:17.664155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200cfd7-4d5a-4284-b89f-765f0c752078 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:17.739542 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:17.778883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200cfd7-4d5a-4284-b89f-765f0c752078 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:17.794497 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee358-1f0c-4a1c-a3bd-be7301ac6e39 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:17.825675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b6ffb-c15e-4b2b-8c39-9a276ac54082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:17.826743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b6ffb-c15e-4b2b-8c39-9a276ac54082 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.827304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b6ffb-c15e-4b2b-8c39-9a276ac54082 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.827808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b6ffb-c15e-4b2b-8c39-9a276ac54082 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.828723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b6ffb-c15e-4b2b-8c39-9a276ac54082 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:17.829263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b6ffb-c15e-4b2b-8c39-9a276ac54082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:17.830839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b6ffb-c15e-4b2b-8c39-9a276ac54082 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:17.832023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7a530-6ae6-4077-959f-3958612fb9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:17.832682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7a530-6ae6-4077-959f-3958612fb9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:17.832967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7a530-6ae6-4077-959f-3958612fb9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:17.833244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7a530-6ae6-4077-959f-3958612fb9c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:17.834089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7a530-6ae6-4077-959f-3958612fb9c4 None admin] RBAC: Adding query filter params (role.id=72d7841f0705491c9a7d4a2679d94457, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=3bc3da0a04de412eb239aeb0b2e99eb3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:17.834908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7a530-6ae6-4077-959f-3958612fb9c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:17.836772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7a530-6ae6-4077-959f-3958612fb9c4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:17.839125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 457/916] 10.222.0.46 () {56 vars in 1114 bytes} [Tue Jun 21 15:45:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:17.844319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b6ffb-c15e-4b2b-8c39-9a276ac54082 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:17.847985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 460/917] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:17 2022] GET /identity/v3/role_assignments?user.id=3bc3da0a04de412eb239aeb0b2e99eb3&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=72d7841f0705491c9a7d4a2679d94457 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:17.914405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:17.966912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b6ffb-c15e-4b2b-8c39-9a276ac54082 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:18.005371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7750916-2d31-40ba-9bc8-815c7e92ef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:18.006060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7750916-2d31-40ba-9bc8-815c7e92ef66 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:18.007301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7750916-2d31-40ba-9bc8-815c7e92ef66 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:18.007599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7750916-2d31-40ba-9bc8-815c7e92ef66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:18.008385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7750916-2d31-40ba-9bc8-815c7e92ef66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:18.009793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7750916-2d31-40ba-9bc8-815c7e92ef66 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:18.032380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 458/918] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jun 21 15:45:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:18.116393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e8cbb-c370-445b-9505-25db8e3e398d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:18.117060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e8cbb-c370-445b-9505-25db8e3e398d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:18.117573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e8cbb-c370-445b-9505-25db8e3e398d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:18.119565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 461/919] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:18.125324 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db5b1-f0bc-4a68-a2ee-d8daa5248abf None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:18.125617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db5b1-f0bc-4a68-a2ee-d8daa5248abf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:18.125905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db5b1-f0bc-4a68-a2ee-d8daa5248abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:18.147505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-223db5b1-f0bc-4a68-a2ee-d8daa5248abf None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:18.148869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-223db5b1-f0bc-4a68-a2ee-d8daa5248abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:18.234987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 459/920] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:18.255302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e8cbb-c370-445b-9505-25db8e3e398d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:18.369595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e8cbb-c370-445b-9505-25db8e3e398d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:18.399412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:18.409693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d1c3-79a4-4991-9340-387e759e028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:18.410850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d1c3-79a4-4991-9340-387e759e028e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:18.411366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d1c3-79a4-4991-9340-387e759e028e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:18.411859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d1c3-79a4-4991-9340-387e759e028e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:18.413249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030d1c3-79a4-4991-9340-387e759e028e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:18.415001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030d1c3-79a4-4991-9340-387e759e028e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c030d1c3-79a4-4991-9340-387e759e028e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:18.428037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:18.429380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:18.430205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:18.432937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 462/921] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:18.440346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223db5b1-f0bc-4a68-a2ee-d8daa5248abf None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:18.486898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:18.562749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223db5b1-f0bc-4a68-a2ee-d8daa5248abf None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:18.600309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4464a8-7da0-47f9-9030-833dd726872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:18.601170 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4464a8-7da0-47f9-9030-833dd726872d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:18.601579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4464a8-7da0-47f9-9030-833dd726872d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:18.601865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4464a8-7da0-47f9-9030-833dd726872d None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:18.602644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4464a8-7da0-47f9-9030-833dd726872d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:18.602962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4464a8-7da0-47f9-9030-833dd726872d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:18.604392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4464a8-7da0-47f9-9030-833dd726872d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:18.612438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 460/922] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jun 21 15:45:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:18.617124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d1c3-79a4-4991-9340-387e759e028e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:18.730172 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d1c3-79a4-4991-9340-387e759e028e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:18.766145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f011d3d-ec11-4cf0-b3ac-7ead5162bef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:18.766813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f011d3d-ec11-4cf0-b3ac-7ead5162bef9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:18.767098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f011d3d-ec11-4cf0-b3ac-7ead5162bef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:18.767405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f011d3d-ec11-4cf0-b3ac-7ead5162bef9 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:18.768114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f011d3d-ec11-4cf0-b3ac-7ead5162bef9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:18.768424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f011d3d-ec11-4cf0-b3ac-7ead5162bef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:18.769793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f011d3d-ec11-4cf0-b3ac-7ead5162bef9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:18.775338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 463/923] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jun 21 15:45:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:18.784206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4464a8-7da0-47f9-9030-833dd726872d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:18.890555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:18.896286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4464a8-7da0-47f9-9030-833dd726872d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:18.946614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f9dc5-07b9-4f27-84e5-af9e08a7da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:18.947717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9dc5-07b9-4f27-84e5-af9e08a7da8f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:18.948203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9dc5-07b9-4f27-84e5-af9e08a7da8f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:18.948690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9dc5-07b9-4f27-84e5-af9e08a7da8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:18.949699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f9dc5-07b9-4f27-84e5-af9e08a7da8f None admin] RBAC: Adding query filter params (interface=public, service_id=6c7c9cfc79f54720bbabacd91e59405a, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:18.950247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f9dc5-07b9-4f27-84e5-af9e08a7da8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:18.951916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f9dc5-07b9-4f27-84e5-af9e08a7da8f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:18.958441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 461/924] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jun 21 15:45:18 2022] GET /identity/v3/endpoints?service_id=6c7c9cfc79f54720bbabacd91e59405a&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:18.965065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f011d3d-ec11-4cf0-b3ac-7ead5162bef9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:19.029293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:19.079149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f011d3d-ec11-4cf0-b3ac-7ead5162bef9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:19.119042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aedd9e-64af-4c34-aaee-3c0f578b38e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:19.119742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aedd9e-64af-4c34-aaee-3c0f578b38e9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:19.120029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aedd9e-64af-4c34-aaee-3c0f578b38e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:19.120308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aedd9e-64af-4c34-aaee-3c0f578b38e9 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:19.121003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aedd9e-64af-4c34-aaee-3c0f578b38e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:19.122402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aedd9e-64af-4c34-aaee-3c0f578b38e9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:19.135351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 464/925] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jun 21 15:45:18 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:45:19.434087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246f08e-76f4-462b-8e8a-86741f771943 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:19.434468 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246f08e-76f4-462b-8e8a-86741f771943 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:19.434663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246f08e-76f4-462b-8e8a-86741f771943 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:19.436188 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 462/926] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:19.441684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0801a7-b480-4c3f-b93d-88e6c87aac78 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:19.442569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0801a7-b480-4c3f-b93d-88e6c87aac78 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:19.443079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0801a7-b480-4c3f-b93d-88e6c87aac78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:19.461118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0b0801a7-b480-4c3f-b93d-88e6c87aac78 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:19.462668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b0801a7-b480-4c3f-b93d-88e6c87aac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:19.536941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 465/927] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:19.561811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246f08e-76f4-462b-8e8a-86741f771943 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:19.676046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246f08e-76f4-462b-8e8a-86741f771943 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:19.713049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592c45-8365-4a69-b8f7-201f7b2b5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:19.714235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592c45-8365-4a69-b8f7-201f7b2b5802 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:19.714741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592c45-8365-4a69-b8f7-201f7b2b5802 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:19.715251 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592c45-8365-4a69-b8f7-201f7b2b5802 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:19.716149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51592c45-8365-4a69-b8f7-201f7b2b5802 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:19.717774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51592c45-8365-4a69-b8f7-201f7b2b5802 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-51592c45-8365-4a69-b8f7-201f7b2b5802 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:19.731981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:19.733002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:45:19.733831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:19.736866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 463/928] 10.222.0.46 () {56 vars in 1132 bytes} [Tue Jun 21 15:45:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:19.743552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0801a7-b480-4c3f-b93d-88e6c87aac78 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:19.796161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:19.852863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0801a7-b480-4c3f-b93d-88e6c87aac78 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:19.893753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc077954-dd74-421e-979f-218e9557f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:19.894828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077954-dd74-421e-979f-218e9557f318 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:19.895362 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077954-dd74-421e-979f-218e9557f318 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:19.895852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077954-dd74-421e-979f-218e9557f318 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:19.896794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc077954-dd74-421e-979f-218e9557f318 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:19.897476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc077954-dd74-421e-979f-218e9557f318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:19.899153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc077954-dd74-421e-979f-218e9557f318 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:19.905070 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 466/929] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:19.915222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592c45-8365-4a69-b8f7-201f7b2b5802 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:19.983673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:20.019735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592c45-8365-4a69-b8f7-201f7b2b5802 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:20.040164 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e0d9-4ed1-4eec-8dd1-5aa8566913d0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.040828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e0d9-4ed1-4eec-8dd1-5aa8566913d0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.041328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e0d9-4ed1-4eec-8dd1-5aa8566913d0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.043240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 467/930] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:20.048836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889adf7e-58ad-4ab4-a31d-7f908beb050d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.049452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889adf7e-58ad-4ab4-a31d-7f908beb050d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.049940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889adf7e-58ad-4ab4-a31d-7f908beb050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.058144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a449874-7c94-4979-b09c-b009d37e19d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:20.058825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a449874-7c94-4979-b09c-b009d37e19d6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.059117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a449874-7c94-4979-b09c-b009d37e19d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.059437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a449874-7c94-4979-b09c-b009d37e19d6 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.060162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a449874-7c94-4979-b09c-b009d37e19d6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:20.060477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a449874-7c94-4979-b09c-b009d37e19d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:20.061880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a449874-7c94-4979-b09c-b009d37e19d6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:20.067947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 464/931] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:20.070604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-889adf7e-58ad-4ab4-a31d-7f908beb050d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:20.072119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-889adf7e-58ad-4ab4-a31d-7f908beb050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:20.073602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a449874-7c94-4979-b09c-b009d37e19d6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:20.155272 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 468/932] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:20.174064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889adf7e-58ad-4ab4-a31d-7f908beb050d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:20.175718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:20.186334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a449874-7c94-4979-b09c-b009d37e19d6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:20.223535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360393a-483b-438e-abaf-cbade2fb8b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:20.224199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360393a-483b-438e-abaf-cbade2fb8b26 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.227202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360393a-483b-438e-abaf-cbade2fb8b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.227202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360393a-483b-438e-abaf-cbade2fb8b26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.227202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360393a-483b-438e-abaf-cbade2fb8b26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:20.227202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360393a-483b-438e-abaf-cbade2fb8b26 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:20.237343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:20.259732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 465/933] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jun 21 15:45:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:45:20.312922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889adf7e-58ad-4ab4-a31d-7f908beb050d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:20.361220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a622ba-7fab-4b59-b96d-41228a368800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:20.362067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a622ba-7fab-4b59-b96d-41228a368800 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.362348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a622ba-7fab-4b59-b96d-41228a368800 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.362687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a622ba-7fab-4b59-b96d-41228a368800 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.375852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a622ba-7fab-4b59-b96d-41228a368800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d8a622ba-7fab-4b59-b96d-41228a368800 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:20.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:20.386377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:20.387253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 469/934] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jun 21 15:45:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:20.392961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360393a-483b-438e-abaf-cbade2fb8b26 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:20.437802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81f1a5-9a8b-4442-bc35-d2733bde3b78 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.438110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81f1a5-9a8b-4442-bc35-d2733bde3b78 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.438360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81f1a5-9a8b-4442-bc35-d2733bde3b78 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.440967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 470/935] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:20.445571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2f8d-aa3f-4832-a3e5-8d9d44e96741 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.446170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2f8d-aa3f-4832-a3e5-8d9d44e96741 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.446170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2f8d-aa3f-4832-a3e5-8d9d44e96741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.468567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2cfc2f8d-aa3f-4832-a3e5-8d9d44e96741 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:20.469791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cfc2f8d-aa3f-4832-a3e5-8d9d44e96741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:20.541371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360393a-483b-438e-abaf-cbade2fb8b26 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:20.571036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 471/936] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:20.582236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e509-e137-4399-b026-70940a32b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:20.582910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e509-e137-4399-b026-70940a32b6db None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.583275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e509-e137-4399-b026-70940a32b6db None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.583552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e509-e137-4399-b026-70940a32b6db None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.584366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3e509-e137-4399-b026-70940a32b6db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:20.584725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3e509-e137-4399-b026-70940a32b6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:20.586140 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3e509-e137-4399-b026-70940a32b6db None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:20.595854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc2f8d-aa3f-4832-a3e5-8d9d44e96741 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:20.597166 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 466/937] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jun 21 15:45:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:20.603536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e509-e137-4399-b026-70940a32b6db None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:20.620163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:20.639811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:20.719825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e509-e137-4399-b026-70940a32b6db None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:20.737294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc2f8d-aa3f-4832-a3e5-8d9d44e96741 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:20.758580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52b20e-01d2-421b-b7e5-ddf1bd1bd49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:20.759568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52b20e-01d2-421b-b7e5-ddf1bd1bd49d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.759956 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52b20e-01d2-421b-b7e5-ddf1bd1bd49d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.760338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52b20e-01d2-421b-b7e5-ddf1bd1bd49d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.772487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52b20e-01d2-421b-b7e5-ddf1bd1bd49d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:20.774433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52b20e-01d2-421b-b7e5-ddf1bd1bd49d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:20.782160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:20.783084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.783553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.784358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.785515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:20.787099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:20.788793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: WARNING keystone.server.flask.common [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-fb52b20e-01d2-421b-b7e5-ddf1bd1bd49d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:20.794255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:20.795323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:20.796280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:20.796280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:20.796280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:20.796280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:20.801792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 467/938] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:20.802738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52b20e-01d2-421b-b7e5-ddf1bd1bd49d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:20.813144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.sql.core [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 15:45:20.813144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 15:45:20.813144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [parameters: {'id': 'ac2ec33f08734ac49efdd3e3d950efd3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 15:45:20.813144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80234) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac2ec33f08734ac49efdd3e3d950efd3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac2ec33f08734ac49efdd3e3d950efd3. Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:45:20.824511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result.read() Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 21 15:45:20.825313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application yield resource Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise self.value Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application session.commit() Jun 21 15:45:20.826296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.session.flush() Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application compat.raise_( Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 15:45:20.827203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 15:45:20.829157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result.read() Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:45:20.830576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [parameters: {'id': 'ac2ec33f08734ac49efdd3e3d950efd3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:20.833433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:20.836135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac2ec33f08734ac49efdd3e3d950efd3. Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 472/939] 10.222.0.46 () {60 vars in 1140 bytes} [Tue Jun 21 15:45:20 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:20.837025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:20.885596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:20.940518 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52b20e-01d2-421b-b7e5-ddf1bd1bd49d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:20.953840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:20.979055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5ee2c-8d3c-4654-80ec-789c726208e8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:20.986998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34dcf4-1646-447b-b6de-557375d3adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:20.987764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34dcf4-1646-447b-b6de-557375d3adb4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:20.988060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34dcf4-1646-447b-b6de-557375d3adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:20.988345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34dcf4-1646-447b-b6de-557375d3adb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:20.989081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34dcf4-1646-447b-b6de-557375d3adb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:20.989402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34dcf4-1646-447b-b6de-557375d3adb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:20.991334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34dcf4-1646-447b-b6de-557375d3adb4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:21.010947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 468/940] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:21.011988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34dcf4-1646-447b-b6de-557375d3adb4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:21.028945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b133-f3a7-40f2-8e75-cea19c17531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:21.030429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b133-f3a7-40f2-8e75-cea19c17531b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:21.030921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b133-f3a7-40f2-8e75-cea19c17531b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:21.031547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b133-f3a7-40f2-8e75-cea19c17531b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:21.045116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867b133-f3a7-40f2-8e75-cea19c17531b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:21.047943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867b133-f3a7-40f2-8e75-cea19c17531b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c867b133-f3a7-40f2-8e75-cea19c17531b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:21.072587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:21.073716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:21.074802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:21.074802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:21.074802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:21.074802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:21.074802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:21.074802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:21.074802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:21.074802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:21.081884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 473/941] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:21.082698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b133-f3a7-40f2-8e75-cea19c17531b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:21.134728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34dcf4-1646-447b-b6de-557375d3adb4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:21.160795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:21.176190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3d47-1341-43a4-aa43-c719370bb1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:21.177016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3d47-1341-43a4-aa43-c719370bb1ce None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:21.177307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3d47-1341-43a4-aa43-c719370bb1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:21.177591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3d47-1341-43a4-aa43-c719370bb1ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:21.187557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c3d47-1341-43a4-aa43-c719370bb1ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:21.189488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c3d47-1341-43a4-aa43-c719370bb1ce None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-b91c3d47-1341-43a4-aa43-c719370bb1ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:21.206573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:21.207588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:21.208523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:21.208523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:21.208523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:21.208523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:21.208523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:21.208523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:21.208523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:21.208523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:21.208523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:45:21.208523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:21.212167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b133-f3a7-40f2-8e75-cea19c17531b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:21.213527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 469/942] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jun 21 15:45:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:21.215000 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3d47-1341-43a4-aa43-c719370bb1ce None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:21.259143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34144b5-cede-41dc-8dc0-15786bfdcd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:21.260210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34144b5-cede-41dc-8dc0-15786bfdcd66 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:21.260682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34144b5-cede-41dc-8dc0-15786bfdcd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:21.261632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34144b5-cede-41dc-8dc0-15786bfdcd66 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:21.262584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34144b5-cede-41dc-8dc0-15786bfdcd66 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:21.263107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34144b5-cede-41dc-8dc0-15786bfdcd66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:21.265692 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34144b5-cede-41dc-8dc0-15786bfdcd66 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:21.305036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 474/943] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:21.338797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3d47-1341-43a4-aa43-c719370bb1ce None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:21.380480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf7205-fd7d-4713-9bf1-4943edc8bb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:21.381969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7205-fd7d-4713-9bf1-4943edc8bb4b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:21.382266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7205-fd7d-4713-9bf1-4943edc8bb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:21.382551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7205-fd7d-4713-9bf1-4943edc8bb4b None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:21.383466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7205-fd7d-4713-9bf1-4943edc8bb4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:21.383785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7205-fd7d-4713-9bf1-4943edc8bb4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:21.385253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7205-fd7d-4713-9bf1-4943edc8bb4b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:21.407074 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 470/944] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jun 21 15:45:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:21.413484 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34144b5-cede-41dc-8dc0-15786bfdcd66 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:21.423256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:21.538912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34144b5-cede-41dc-8dc0-15786bfdcd66 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:21.576546 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb94eeb-485c-4cbf-8a42-3fe12bf07e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:21.577273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb94eeb-485c-4cbf-8a42-3fe12bf07e1b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:21.577563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb94eeb-485c-4cbf-8a42-3fe12bf07e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:21.577842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb94eeb-485c-4cbf-8a42-3fe12bf07e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:21.580857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da321ac-fbd0-4662-9761-a06c53e4f6b2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:21.581260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da321ac-fbd0-4662-9761-a06c53e4f6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:21.581638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da321ac-fbd0-4662-9761-a06c53e4f6b2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:21.583232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 471/945] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:45:21.590189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb94eeb-485c-4cbf-8a42-3fe12bf07e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:21.590374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590590-4b71-4f0b-bacf-33c0e886b46f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:21.590738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590590-4b71-4f0b-bacf-33c0e886b46f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:21.591308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590590-4b71-4f0b-bacf-33c0e886b46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:21.591712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb94eeb-485c-4cbf-8a42-3fe12bf07e1b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:21.612509 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-37590590-4b71-4f0b-bacf-33c0e886b46f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:21.614091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-37590590-4b71-4f0b-bacf-33c0e886b46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-acb94eeb-485c-4cbf-8a42-3fe12bf07e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:21.617182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:21.618095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:21.618977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:21.618977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:21.618977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:21.618977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:21.618977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 475/946] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:21.626793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb94eeb-485c-4cbf-8a42-3fe12bf07e1b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:21.660340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:21.700916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 472/947] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:21.711515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:21.724779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590590-4b71-4f0b-bacf-33c0e886b46f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:21.757960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb94eeb-485c-4cbf-8a42-3fe12bf07e1b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:21.802762 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951674-a8aa-474a-a41b-56b18504e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:21.804145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951674-a8aa-474a-a41b-56b18504e961 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:21.804467 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951674-a8aa-474a-a41b-56b18504e961 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:21.805296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951674-a8aa-474a-a41b-56b18504e961 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:21.806040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951674-a8aa-474a-a41b-56b18504e961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:21.806360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951674-a8aa-474a-a41b-56b18504e961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:21.808813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951674-a8aa-474a-a41b-56b18504e961 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:21.827322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 476/948] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:21.832130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951674-a8aa-474a-a41b-56b18504e961 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:21.839281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590590-4b71-4f0b-bacf-33c0e886b46f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:21.890809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7136eb-00a4-45e4-94d7-072a6b02d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:21.892573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7136eb-00a4-45e4-94d7-072a6b02d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:21.893324 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7136eb-00a4-45e4-94d7-072a6b02d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:21.893806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7136eb-00a4-45e4-94d7-072a6b02d5a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:21.894921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7136eb-00a4-45e4-94d7-072a6b02d5a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:21.897222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7136eb-00a4-45e4-94d7-072a6b02d5a4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-5f7136eb-00a4-45e4-94d7-072a6b02d5a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:21.911731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:21.913316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:21.914192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:21.917175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 473/949] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:21.927199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7136eb-00a4-45e4-94d7-072a6b02d5a4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:21.955656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951674-a8aa-474a-a41b-56b18504e961 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:21.975998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:21.978494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:22.001732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691f85e-e338-4057-a1e2-6992f7342349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:22.002944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691f85e-e338-4057-a1e2-6992f7342349 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:22.003429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691f85e-e338-4057-a1e2-6992f7342349 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:22.003882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691f85e-e338-4057-a1e2-6992f7342349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:22.011856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691f85e-e338-4057-a1e2-6992f7342349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:22.013939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691f85e-e338-4057-a1e2-6992f7342349 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2691f85e-e338-4057-a1e2-6992f7342349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:22.029152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:22.030109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:22.031008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:22.031008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:22.031008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:22.031008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:22.031008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:22.031008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:22.031008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:22.031008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:22.034244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 477/950] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:22.041149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691f85e-e338-4057-a1e2-6992f7342349 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:22.062011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7136eb-00a4-45e4-94d7-072a6b02d5a4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:22.113681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a656fc2-b922-491d-abbc-a7830b861995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:22.114700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a656fc2-b922-491d-abbc-a7830b861995 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:22.115069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a656fc2-b922-491d-abbc-a7830b861995 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:22.115457 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a656fc2-b922-491d-abbc-a7830b861995 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:22.117445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a656fc2-b922-491d-abbc-a7830b861995 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:22.117840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a656fc2-b922-491d-abbc-a7830b861995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:22.119936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a656fc2-b922-491d-abbc-a7830b861995 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:22.131332 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 474/951] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jun 21 15:45:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:22.134316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a656fc2-b922-491d-abbc-a7830b861995 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:22.176196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691f85e-e338-4057-a1e2-6992f7342349 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:22.220604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ebd2f-8421-4da8-be73-9b5a9ec7ba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:22.221924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebd2f-8421-4da8-be73-9b5a9ec7ba93 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:22.222461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebd2f-8421-4da8-be73-9b5a9ec7ba93 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:22.222948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebd2f-8421-4da8-be73-9b5a9ec7ba93 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:22.224238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ebd2f-8421-4da8-be73-9b5a9ec7ba93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:22.225966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ebd2f-8421-4da8-be73-9b5a9ec7ba93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:22.227969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ebd2f-8421-4da8-be73-9b5a9ec7ba93 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:22.248928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 478/952] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:22.249861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ebd2f-8421-4da8-be73-9b5a9ec7ba93 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:22.263345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:22.270552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a656fc2-b922-491d-abbc-a7830b861995 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:22.300160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:22.307920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27565c-9475-4e9e-8fe7-872d25e6744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:22.308599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27565c-9475-4e9e-8fe7-872d25e6744c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:22.308888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27565c-9475-4e9e-8fe7-872d25e6744c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:22.309172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27565c-9475-4e9e-8fe7-872d25e6744c None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:22.309930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27565c-9475-4e9e-8fe7-872d25e6744c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:22.310311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27565c-9475-4e9e-8fe7-872d25e6744c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:22.312019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27565c-9475-4e9e-8fe7-872d25e6744c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:22.321909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 475/953] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jun 21 15:45:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:22.323014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27565c-9475-4e9e-8fe7-872d25e6744c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:22.382404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ebd2f-8421-4da8-be73-9b5a9ec7ba93 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:22.432022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c4865-c1ae-47da-9ede-adfba990dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:22.433342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4865-c1ae-47da-9ede-adfba990dc35 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:22.433905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4865-c1ae-47da-9ede-adfba990dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:22.434394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4865-c1ae-47da-9ede-adfba990dc35 None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/3bc3da0a04de412eb239aeb0b2e99eb3/roles/72d7841f0705491c9a7d4a2679d94457` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:22.437154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c4865-c1ae-47da-9ede-adfba990dc35 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=3bc3da0a04de412eb239aeb0b2e99eb3, role_id=72d7841f0705491c9a7d4a2679d94457)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:22.438996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c4865-c1ae-47da-9ede-adfba990dc35 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:22.455440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 479/954] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:45:22 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/3bc3da0a04de412eb239aeb0b2e99eb3/roles/72d7841f0705491c9a7d4a2679d94457 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:45:22.464222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b12f-741a-4839-bf14-556e779b8ad6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:22.464550 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b12f-741a-4839-bf14-556e779b8ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:22.464787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b12f-741a-4839-bf14-556e779b8ad6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:22.470496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 480/955] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:45:22.471572 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27565c-9475-4e9e-8fe7-872d25e6744c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:22.471961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8230-4a16-43e6-b2a8-e11b6cfb9878 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:22.472255 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8230-4a16-43e6-b2a8-e11b6cfb9878 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:22.472544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8230-4a16-43e6-b2a8-e11b6cfb9878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:22.491737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ce3e8230-4a16-43e6-b2a8-e11b6cfb9878 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:22.493749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce3e8230-4a16-43e6-b2a8-e11b6cfb9878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:22.529470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bb449-e46f-4a2d-8e41-1ba902cf7d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:22.530862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb449-e46f-4a2d-8e41-1ba902cf7d0f None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:22.532004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb449-e46f-4a2d-8e41-1ba902cf7d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:22.532774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb449-e46f-4a2d-8e41-1ba902cf7d0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:22.533990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bb449-e46f-4a2d-8e41-1ba902cf7d0f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:22.535934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bb449-e46f-4a2d-8e41-1ba902cf7d0f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:22.571876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 476/956] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jun 21 15:45:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:22.611406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 481/957] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:22.629635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bb449-e46f-4a2d-8e41-1ba902cf7d0f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:22.655694 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:22.766089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bb449-e46f-4a2d-8e41-1ba902cf7d0f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:22.818050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cd986-c0d6-4446-824d-3204a5afc205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:22.819194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cd986-c0d6-4446-824d-3204a5afc205 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:22.819502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cd986-c0d6-4446-824d-3204a5afc205 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:22.819901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cd986-c0d6-4446-824d-3204a5afc205 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:22.820656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cd986-c0d6-4446-824d-3204a5afc205 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:22.822044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cd986-c0d6-4446-824d-3204a5afc205 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f22cd986-c0d6-4446-824d-3204a5afc205 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:22.834749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:22.835917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:22.836907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 477/958] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:22.842603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8230-4a16-43e6-b2a8-e11b6cfb9878 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:22.869115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:22.952863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8230-4a16-43e6-b2a8-e11b6cfb9878 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:22.992753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd537343-8e15-404d-a4de-176e93cd945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:22.993577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537343-8e15-404d-a4de-176e93cd945a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:22.993945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537343-8e15-404d-a4de-176e93cd945a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:22.994223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537343-8e15-404d-a4de-176e93cd945a None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:22.995061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd537343-8e15-404d-a4de-176e93cd945a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:22.995397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd537343-8e15-404d-a4de-176e93cd945a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:22.996791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd537343-8e15-404d-a4de-176e93cd945a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:23.002529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 482/959] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:23.008030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cd986-c0d6-4446-824d-3204a5afc205 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:23.102731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:23.122563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cd986-c0d6-4446-824d-3204a5afc205 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:23.160420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e082c-ee8a-4982-a5bb-2d79e5dae2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:23.161096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e082c-ee8a-4982-a5bb-2d79e5dae2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:23.161385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e082c-ee8a-4982-a5bb-2d79e5dae2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:23.161666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e082c-ee8a-4982-a5bb-2d79e5dae2a6 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:23.162379 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e082c-ee8a-4982-a5bb-2d79e5dae2a6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:23.162771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e082c-ee8a-4982-a5bb-2d79e5dae2a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:23.164175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e082c-ee8a-4982-a5bb-2d79e5dae2a6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:23.169444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 478/960] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:23.587534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b2fba-b590-4856-86bb-4a14eaa3dc57 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:23.587921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b2fba-b590-4856-86bb-4a14eaa3dc57 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:23.588119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b2fba-b590-4856-86bb-4a14eaa3dc57 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:23.589698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 483/961] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:23.595093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397cd1-979b-43d1-b452-4f44510e06a5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:23.595428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397cd1-979b-43d1-b452-4f44510e06a5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:23.595711 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397cd1-979b-43d1-b452-4f44510e06a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:23.614158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ed397cd1-979b-43d1-b452-4f44510e06a5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:23.615398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ed397cd1-979b-43d1-b452-4f44510e06a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:23.688819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 479/962] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:23.714079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b2fba-b590-4856-86bb-4a14eaa3dc57 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:23.810042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:23.825246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b2fba-b590-4856-86bb-4a14eaa3dc57 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:23.863364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151683f-1eda-4a01-aeae-15aacb77caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:23.864088 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151683f-1eda-4a01-aeae-15aacb77caee None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:23.864374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151683f-1eda-4a01-aeae-15aacb77caee None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:23.864650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151683f-1eda-4a01-aeae-15aacb77caee None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:23.865363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151683f-1eda-4a01-aeae-15aacb77caee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:23.867046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151683f-1eda-4a01-aeae-15aacb77caee None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:23.880453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.sql.core [None req-1151683f-1eda-4a01-aeae-15aacb77caee None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 15:45:23.880453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 15:45:23.880453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [parameters: {'user_id': '9ba5d9f2638b46f9809c7afdb6cd26a2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 15:45:23.880453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80234) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1151683f-1eda-4a01-aeae-15aacb77caee None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result.read() Jun 21 15:45:23.889009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:45:23.889912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application yield resource Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise self.value Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application session.commit() Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 15:45:23.890890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.session.flush() Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application compat.raise_( Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 15:45:23.891817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:45:23.892752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result.read() Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:45:23.893593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [parameters: {'user_id': '9ba5d9f2638b46f9809c7afdb6cd26a2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:23.894428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 21 15:45:23.899027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 21 15:45:23.901218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 21 15:45:23.901218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 21 15:45:23.901218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 15:45:23.901218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 15:45:23.901218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 15:45:23.901218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:23.901218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 484/963] 10.222.0.46 () {60 vars in 1131 bytes} [Tue Jun 21 15:45:23 2022] POST /identity/v3/users => generated 160 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:23.901906 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed397cd1-979b-43d1-b452-4f44510e06a5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:23.987191 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:24.010775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed397cd1-979b-43d1-b452-4f44510e06a5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:24.046546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea8c55-8f0c-475a-ba0e-a55efd715083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:24.047381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8c55-8f0c-475a-ba0e-a55efd715083 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:24.047676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8c55-8f0c-475a-ba0e-a55efd715083 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:24.047960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8c55-8f0c-475a-ba0e-a55efd715083 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:24.055583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea8c55-8f0c-475a-ba0e-a55efd715083 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:24.057032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea8c55-8f0c-475a-ba0e-a55efd715083 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-0fea8c55-8f0c-475a-ba0e-a55efd715083 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:24.071776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:24.073874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:24.075648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 480/964] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:45:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:24.079003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151683f-1eda-4a01-aeae-15aacb77caee None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:24.185900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151683f-1eda-4a01-aeae-15aacb77caee None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:24.220585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b70539-9c59-4c8b-bb42-d313f82a444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:24.221314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b70539-9c59-4c8b-bb42-d313f82a444c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:24.221601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b70539-9c59-4c8b-bb42-d313f82a444c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:24.221932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b70539-9c59-4c8b-bb42-d313f82a444c None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:24.222743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b70539-9c59-4c8b-bb42-d313f82a444c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:24.223053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b70539-9c59-4c8b-bb42-d313f82a444c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:24.224708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b70539-9c59-4c8b-bb42-d313f82a444c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:24.265520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 485/965] 10.222.0.46 () {56 vars in 1101 bytes} [Tue Jun 21 15:45:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:24.718335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e146c-962d-45fd-af7a-7b053acab64f None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:24.718729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e146c-962d-45fd-af7a-7b053acab64f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:24.718923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e146c-962d-45fd-af7a-7b053acab64f None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:24.720468 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 481/966] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:24.726642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052c4d4-67b0-4654-8289-0428a2150df6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:24.727229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052c4d4-67b0-4654-8289-0428a2150df6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:24.727525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052c4d4-67b0-4654-8289-0428a2150df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:24.745025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2052c4d4-67b0-4654-8289-0428a2150df6 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:24.746581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2052c4d4-67b0-4654-8289-0428a2150df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:24.748748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:24.807309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb511f-965d-4f18-a41e-3b333685fa3d None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:24.807666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb511f-965d-4f18-a41e-3b333685fa3d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:24.807880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb511f-965d-4f18-a41e-3b333685fa3d None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:24.809378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 482/967] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:45:24.814197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df3831-42dc-479b-8c49-a99076840fe6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:24.814485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df3831-42dc-479b-8c49-a99076840fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:24.814766 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df3831-42dc-479b-8c49-a99076840fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:24.823304 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 486/968] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:24.831388 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-41df3831-42dc-479b-8c49-a99076840fe6 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:24.832588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-41df3831-42dc-479b-8c49-a99076840fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:24.845103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052c4d4-67b0-4654-8289-0428a2150df6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:24.914851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 483/969] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:24.938549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df3831-42dc-479b-8c49-a99076840fe6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:24.966547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052c4d4-67b0-4654-8289-0428a2150df6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.007211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca8701-c475-4389-ac5a-4ddcc7dbae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.007967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca8701-c475-4389-ac5a-4ddcc7dbae91 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.008262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca8701-c475-4389-ac5a-4ddcc7dbae91 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.008751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:25.008872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca8701-c475-4389-ac5a-4ddcc7dbae91 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.017581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:25.025306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca8701-c475-4389-ac5a-4ddcc7dbae91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-dbca8701-c475-4389-ac5a-4ddcc7dbae91 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:25.034089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:25.035241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:25.036687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 487/970] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jun 21 15:45:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:25.042155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca8701-c475-4389-ac5a-4ddcc7dbae91 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:25.052221 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df3831-42dc-479b-8c49-a99076840fe6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.090312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d208b6-5dd5-4bf5-8bfb-f1f6719fd91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.091128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d208b6-5dd5-4bf5-8bfb-f1f6719fd91b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.091445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d208b6-5dd5-4bf5-8bfb-f1f6719fd91b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.091723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d208b6-5dd5-4bf5-8bfb-f1f6719fd91b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.092373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d208b6-5dd5-4bf5-8bfb-f1f6719fd91b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:25.093757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d208b6-5dd5-4bf5-8bfb-f1f6719fd91b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-e0d208b6-5dd5-4bf5-8bfb-f1f6719fd91b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:25.106854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:25.108193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:25.109046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 484/971] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:25.113946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d208b6-5dd5-4bf5-8bfb-f1f6719fd91b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:25.165238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca8701-c475-4389-ac5a-4ddcc7dbae91 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.201661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421a998-4a28-42f4-b1e2-6557064bbe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.202354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421a998-4a28-42f4-b1e2-6557064bbe99 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.202646 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421a998-4a28-42f4-b1e2-6557064bbe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.202932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421a998-4a28-42f4-b1e2-6557064bbe99 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.203722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421a998-4a28-42f4-b1e2-6557064bbe99 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:25.204039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421a998-4a28-42f4-b1e2-6557064bbe99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:25.205429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421a998-4a28-42f4-b1e2-6557064bbe99 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:25.214131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 488/972] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jun 21 15:45:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:25.219639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421a998-4a28-42f4-b1e2-6557064bbe99 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:25.234058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d208b6-5dd5-4bf5-8bfb-f1f6719fd91b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.269318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:25.276477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557faf8-076b-4c97-85db-aca7500dd67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.277149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557faf8-076b-4c97-85db-aca7500dd67b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.277437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557faf8-076b-4c97-85db-aca7500dd67b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.277718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557faf8-076b-4c97-85db-aca7500dd67b None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.278448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557faf8-076b-4c97-85db-aca7500dd67b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:25.278746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557faf8-076b-4c97-85db-aca7500dd67b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:25.280140 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557faf8-076b-4c97-85db-aca7500dd67b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:25.285425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 485/973] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jun 21 15:45:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:25.291386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557faf8-076b-4c97-85db-aca7500dd67b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:25.291566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:25.340531 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421a998-4a28-42f4-b1e2-6557064bbe99 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.376791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1825ec7-7f98-4b63-85f5-97821fcddf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.377588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1825ec7-7f98-4b63-85f5-97821fcddf98 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.377876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1825ec7-7f98-4b63-85f5-97821fcddf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.378155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1825ec7-7f98-4b63-85f5-97821fcddf98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.389596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1825ec7-7f98-4b63-85f5-97821fcddf98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:25.391058 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1825ec7-7f98-4b63-85f5-97821fcddf98 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:25.395516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557faf8-076b-4c97-85db-aca7500dd67b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f1825ec7-7f98-4b63-85f5-97821fcddf98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:25.408205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:25.409145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:25.410057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:25.410057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:25.410057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:25.410057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:25.410057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 489/974] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:25.410728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ece50-a3d8-4565-89c2-f4774020f7ee None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.410962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ece50-a3d8-4565-89c2-f4774020f7ee None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.411275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ece50-a3d8-4565-89c2-f4774020f7ee None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.412621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 490/975] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:25.415039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ece50-a3d8-4565-89c2-f4774020f7ee None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:25.434623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06eb271-f4ed-48d7-86cc-903f2b9cbe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.435333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eb271-f4ed-48d7-86cc-903f2b9cbe8b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.435622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eb271-f4ed-48d7-86cc-903f2b9cbe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.435909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eb271-f4ed-48d7-86cc-903f2b9cbe8b None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.436683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06eb271-f4ed-48d7-86cc-903f2b9cbe8b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:25.436985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06eb271-f4ed-48d7-86cc-903f2b9cbe8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:25.438369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06eb271-f4ed-48d7-86cc-903f2b9cbe8b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:25.445128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 486/976] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jun 21 15:45:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:25.446885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad9ea2-7135-4f11-818b-6f9ce5f83205 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.447370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad9ea2-7135-4f11-818b-6f9ce5f83205 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.447656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad9ea2-7135-4f11-818b-6f9ce5f83205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.467244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-90ad9ea2-7135-4f11-818b-6f9ce5f83205 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:25.468455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-90ad9ea2-7135-4f11-818b-6f9ce5f83205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:25.526226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:25.540916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 487/977] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:25.541741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad9ea2-7135-4f11-818b-6f9ce5f83205 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:25.552276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ece50-a3d8-4565-89c2-f4774020f7ee None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.567094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:25.589116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1dab7-efaf-4b50-b684-57c33672c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.589782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1dab7-efaf-4b50-b684-57c33672c297 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.590069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1dab7-efaf-4b50-b684-57c33672c297 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.590353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1dab7-efaf-4b50-b684-57c33672c297 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.591077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1dab7-efaf-4b50-b684-57c33672c297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:25.591415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1dab7-efaf-4b50-b684-57c33672c297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:25.592787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1dab7-efaf-4b50-b684-57c33672c297 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:25.604641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 491/978] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:25.605441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1dab7-efaf-4b50-b684-57c33672c297 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:25.647336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad9ea2-7135-4f11-818b-6f9ce5f83205 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.684091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ccc7c-5293-4e40-a8fe-70e3a6a3fab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.684750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ccc7c-5293-4e40-a8fe-70e3a6a3fab6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.685039 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ccc7c-5293-4e40-a8fe-70e3a6a3fab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.685321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ccc7c-5293-4e40-a8fe-70e3a6a3fab6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.686128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ccc7c-5293-4e40-a8fe-70e3a6a3fab6 None admin] RBAC: Adding query filter params (interface=admin, service_id=6c7c9cfc79f54720bbabacd91e59405a, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:25.686440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ccc7c-5293-4e40-a8fe-70e3a6a3fab6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:25.687854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ccc7c-5293-4e40-a8fe-70e3a6a3fab6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:25.692985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 488/979] 10.222.0.46 () {56 vars in 1249 bytes} [Tue Jun 21 15:45:25 2022] GET /identity/v3/endpoints?service_id=6c7c9cfc79f54720bbabacd91e59405a&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:25.693827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ccc7c-5293-4e40-a8fe-70e3a6a3fab6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:25.714884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1dab7-efaf-4b50-b684-57c33672c297 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.748611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:25.751416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3c255-085c-4896-8d0a-207f5c0ba62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.752159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3c255-085c-4896-8d0a-207f5c0ba62e None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.752368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3c255-085c-4896-8d0a-207f5c0ba62e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.752647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3c255-085c-4896-8d0a-207f5c0ba62e None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.753362 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3c255-085c-4896-8d0a-207f5c0ba62e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:25.754753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3c255-085c-4896-8d0a-207f5c0ba62e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:25.768282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 492/980] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:45:25 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:25.769097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3c255-085c-4896-8d0a-207f5c0ba62e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:25.809130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ccc7c-5293-4e40-a8fe-70e3a6a3fab6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.817153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:25.859323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d15b9-e55f-4c20-99fa-da20a275b675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.860414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d15b9-e55f-4c20-99fa-da20a275b675 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.860712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d15b9-e55f-4c20-99fa-da20a275b675 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.860994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d15b9-e55f-4c20-99fa-da20a275b675 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.870668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d15b9-e55f-4c20-99fa-da20a275b675 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:25.872176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d15b9-e55f-4c20-99fa-da20a275b675 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9c7d15b9-e55f-4c20-99fa-da20a275b675 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:25.890204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:25.891269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:25.892233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 489/981] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jun 21 15:45:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:25.897679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d15b9-e55f-4c20-99fa-da20a275b675 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:25.912019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3c255-085c-4896-8d0a-207f5c0ba62e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:25.955492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee344b-b8d5-4a0c-a846-bdd777c55feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:25.956431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee344b-b8d5-4a0c-a846-bdd777c55feb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:25.956746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee344b-b8d5-4a0c-a846-bdd777c55feb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:25.957029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee344b-b8d5-4a0c-a846-bdd777c55feb None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:25.957723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee344b-b8d5-4a0c-a846-bdd777c55feb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:25.959216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee344b-b8d5-4a0c-a846-bdd777c55feb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:25.968440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 493/982] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jun 21 15:45:25 2022] GET /identity/v3/services => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:45:26.017943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d15b9-e55f-4c20-99fa-da20a275b675 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:26.029719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:26.063094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6d62-4dba-4c0a-b692-14d5400619d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:26.064541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6d62-4dba-4c0a-b692-14d5400619d1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:26.064995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6d62-4dba-4c0a-b692-14d5400619d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:26.065459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6d62-4dba-4c0a-b692-14d5400619d1 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:26.066565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd6d62-4dba-4c0a-b692-14d5400619d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:26.067066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd6d62-4dba-4c0a-b692-14d5400619d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:26.069556 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd6d62-4dba-4c0a-b692-14d5400619d1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:26.091208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 490/983] 10.222.0.46 () {56 vars in 1149 bytes} [Tue Jun 21 15:45:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:26.096657 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee344b-b8d5-4a0c-a846-bdd777c55feb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:26.202369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:26.209645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee344b-b8d5-4a0c-a846-bdd777c55feb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:26.244804 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c9ccc-7c5c-4e84-ab9c-7f6f84a019a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:26.245618 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c9ccc-7c5c-4e84-ab9c-7f6f84a019a0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:26.246011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c9ccc-7c5c-4e84-ab9c-7f6f84a019a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:26.246426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c9ccc-7c5c-4e84-ab9c-7f6f84a019a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:26.322565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c9ccc-7c5c-4e84-ab9c-7f6f84a019a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:26.324080 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c9ccc-7c5c-4e84-ab9c-7f6f84a019a0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:26.429191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:26.440346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 494/984] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:26 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:45:26.444133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6d62-4dba-4c0a-b692-14d5400619d1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:26.546758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6d62-4dba-4c0a-b692-14d5400619d1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:26.588962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975319b1-4eea-43d5-baec-1c5efa5d37fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:26.589673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975319b1-4eea-43d5-baec-1c5efa5d37fd None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:26.589963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975319b1-4eea-43d5-baec-1c5efa5d37fd None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:26.590243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975319b1-4eea-43d5-baec-1c5efa5d37fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:26.601072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975319b1-4eea-43d5-baec-1c5efa5d37fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:26.602529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975319b1-4eea-43d5-baec-1c5efa5d37fd None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-975319b1-4eea-43d5-baec-1c5efa5d37fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:26.620858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:26.621804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:26.622741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:26.622741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:26.622741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:26.622741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:26.622741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 491/985] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:26.628826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c9ccc-7c5c-4e84-ab9c-7f6f84a019a0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:26.734764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c9ccc-7c5c-4e84-ab9c-7f6f84a019a0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:26.773251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296a632-f004-4ac2-9bfc-a60d41cf2cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:26.773902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296a632-f004-4ac2-9bfc-a60d41cf2cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:26.774195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296a632-f004-4ac2-9bfc-a60d41cf2cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:26.774477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296a632-f004-4ac2-9bfc-a60d41cf2cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:26.775225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296a632-f004-4ac2-9bfc-a60d41cf2cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:26.775540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296a632-f004-4ac2-9bfc-a60d41cf2cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:26.776915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296a632-f004-4ac2-9bfc-a60d41cf2cb8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:26.789748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 495/986] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:26.795264 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975319b1-4eea-43d5-baec-1c5efa5d37fd None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:26.815104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:26.907875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975319b1-4eea-43d5-baec-1c5efa5d37fd None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:26.946385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c88a2-6081-410f-b710-cb2c5c0da0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:26.947646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c88a2-6081-410f-b710-cb2c5c0da0cf None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:26.948298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c88a2-6081-410f-b710-cb2c5c0da0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:26.948849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c88a2-6081-410f-b710-cb2c5c0da0cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:26.956732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c88a2-6081-410f-b710-cb2c5c0da0cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:26.958456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c88a2-6081-410f-b710-cb2c5c0da0cf None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a96c88a2-6081-410f-b710-cb2c5c0da0cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:26.973859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:26.974890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:26.976557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:26.976557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:26.976557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:26.976557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:26.976557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:26.976557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:26.976557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:26.976557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:26.978476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 492/987] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:26.984390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296a632-f004-4ac2-9bfc-a60d41cf2cb8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:27.045287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:27.093583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296a632-f004-4ac2-9bfc-a60d41cf2cb8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:27.132131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188e12f-79dc-46a9-9315-9432b9f865f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:27.132811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188e12f-79dc-46a9-9315-9432b9f865f0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:27.133099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188e12f-79dc-46a9-9315-9432b9f865f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:27.133379 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188e12f-79dc-46a9-9315-9432b9f865f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:27.134180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188e12f-79dc-46a9-9315-9432b9f865f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:27.134493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188e12f-79dc-46a9-9315-9432b9f865f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:27.135966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188e12f-79dc-46a9-9315-9432b9f865f0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:27.149426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 496/988] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:27.155203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c88a2-6081-410f-b710-cb2c5c0da0cf None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:27.238732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:27.263077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c88a2-6081-410f-b710-cb2c5c0da0cf None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:27.302110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01ff79-639a-4529-aac1-a2da659cb9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:27.302765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ff79-639a-4529-aac1-a2da659cb9ab None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:27.303679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ff79-639a-4529-aac1-a2da659cb9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:27.303960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ff79-639a-4529-aac1-a2da659cb9ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:27.304798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01ff79-639a-4529-aac1-a2da659cb9ab None admin] RBAC: Adding query filter params (role.id=72d7841f0705491c9a7d4a2679d94457, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=3bc3da0a04de412eb239aeb0b2e99eb3) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:27.305112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01ff79-639a-4529-aac1-a2da659cb9ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:27.306536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01ff79-639a-4529-aac1-a2da659cb9ab None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:27.313095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 493/989] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:27 2022] GET /identity/v3/role_assignments?user.id=3bc3da0a04de412eb239aeb0b2e99eb3&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=72d7841f0705491c9a7d4a2679d94457 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:27.914862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2941d4-cc67-4f91-a000-9c30a904658c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:27.916105 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2941d4-cc67-4f91-a000-9c30a904658c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:27.916105 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2941d4-cc67-4f91-a000-9c30a904658c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:27.917008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 497/990] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:27.922356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7bd1-17bf-49ee-93fe-6204cb5d6a07 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:27.922657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7bd1-17bf-49ee-93fe-6204cb5d6a07 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:27.922942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7bd1-17bf-49ee-93fe-6204cb5d6a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:27.946613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-486c7bd1-17bf-49ee-93fe-6204cb5d6a07 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:27.947839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-486c7bd1-17bf-49ee-93fe-6204cb5d6a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:28.023262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 494/991] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:28.045757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2941d4-cc67-4f91-a000-9c30a904658c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:28.076883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c5f79-1c97-4b86-9ab2-41127b2a637c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.077188 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c5f79-1c97-4b86-9ab2-41127b2a637c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.077475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c5f79-1c97-4b86-9ab2-41127b2a637c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.078858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 495/992] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:45:28.084152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd7ed9-31ba-4cf3-af78-5dd64972559f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.085209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd7ed9-31ba-4cf3-af78-5dd64972559f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.085668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd7ed9-31ba-4cf3-af78-5dd64972559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.104471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f9bd7ed9-31ba-4cf3-af78-5dd64972559f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:28.106002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f9bd7ed9-31ba-4cf3-af78-5dd64972559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:28.165603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2941d4-cc67-4f91-a000-9c30a904658c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:28.182464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 496/993] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:28.183639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:28.203386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf1ede-3d80-422f-aada-b5c3df1ea875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:28.204300 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf1ede-3d80-422f-aada-b5c3df1ea875 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.204481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf1ede-3d80-422f-aada-b5c3df1ea875 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.204758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf1ede-3d80-422f-aada-b5c3df1ea875 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.205422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf1ede-3d80-422f-aada-b5c3df1ea875 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:28.206080 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd7ed9-31ba-4cf3-af78-5dd64972559f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:28.206795 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf1ede-3d80-422f-aada-b5c3df1ea875 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:28.209189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e7cf1ede-3d80-422f-aada-b5c3df1ea875 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:28.219634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:28.220677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:28.221725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 498/994] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:28.227249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf1ede-3d80-422f-aada-b5c3df1ea875 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:28.324590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd7ed9-31ba-4cf3-af78-5dd64972559f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:28.336025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf1ede-3d80-422f-aada-b5c3df1ea875 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:28.372106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dfb6c-36d5-4e7a-9e30-55fb3d56ca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:28.373017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dfb6c-36d5-4e7a-9e30-55fb3d56ca8e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.373317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dfb6c-36d5-4e7a-9e30-55fb3d56ca8e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.373601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dfb6c-36d5-4e7a-9e30-55fb3d56ca8e None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.373698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b65ba-84c8-4f0f-b1f3-f405949dcd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:28.374323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dfb6c-36d5-4e7a-9e30-55fb3d56ca8e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:28.374488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b65ba-84c8-4f0f-b1f3-f405949dcd45 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.374637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dfb6c-36d5-4e7a-9e30-55fb3d56ca8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:28.374782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b65ba-84c8-4f0f-b1f3-f405949dcd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.375053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b65ba-84c8-4f0f-b1f3-f405949dcd45 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.375747 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b65ba-84c8-4f0f-b1f3-f405949dcd45 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:28.376056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dfb6c-36d5-4e7a-9e30-55fb3d56ca8e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:28.377163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b65ba-84c8-4f0f-b1f3-f405949dcd45 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:28.381836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 499/995] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:28.387168 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dfb6c-36d5-4e7a-9e30-55fb3d56ca8e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-945b65ba-84c8-4f0f-b1f3-f405949dcd45 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:28.391838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:28.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:28.399732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 497/996] 10.222.0.46 () {56 vars in 1126 bytes} [Tue Jun 21 15:45:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:28.400709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b65ba-84c8-4f0f-b1f3-f405949dcd45 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:28.446912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:28.480842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:28.515268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dfb6c-36d5-4e7a-9e30-55fb3d56ca8e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:28.519002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b65ba-84c8-4f0f-b1f3-f405949dcd45 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:28.552338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26550f-c603-4be8-bba2-e00c9d9cb16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:28.553186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26550f-c603-4be8-bba2-e00c9d9cb16e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.553598 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26550f-c603-4be8-bba2-e00c9d9cb16e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.554083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26550f-c603-4be8-bba2-e00c9d9cb16e None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.555154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26550f-c603-4be8-bba2-e00c9d9cb16e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:28.555478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26550f-c603-4be8-bba2-e00c9d9cb16e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:28.556869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26550f-c603-4be8-bba2-e00c9d9cb16e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:28.557284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502ae44-fd0b-46a4-b48e-38ef239ed26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:28.558314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ae44-fd0b-46a4-b48e-38ef239ed26d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.558757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ae44-fd0b-46a4-b48e-38ef239ed26d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.559555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ae44-fd0b-46a4-b48e-38ef239ed26d None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.560443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502ae44-fd0b-46a4-b48e-38ef239ed26d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:28.560905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502ae44-fd0b-46a4-b48e-38ef239ed26d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:28.562049 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 500/997] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:28.562591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502ae44-fd0b-46a4-b48e-38ef239ed26d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:28.567937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26550f-c603-4be8-bba2-e00c9d9cb16e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:28.568164 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 498/998] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jun 21 15:45:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:28.574692 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502ae44-fd0b-46a4-b48e-38ef239ed26d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:28.684114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26550f-c603-4be8-bba2-e00c9d9cb16e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:28.691002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502ae44-fd0b-46a4-b48e-38ef239ed26d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:28.694370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:28.722387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa646ce-17c7-4252-acac-b8254d1dea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:28.722977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa646ce-17c7-4252-acac-b8254d1dea2f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.723146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:28.723292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa646ce-17c7-4252-acac-b8254d1dea2f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.723563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa646ce-17c7-4252-acac-b8254d1dea2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.724393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa646ce-17c7-4252-acac-b8254d1dea2f None admin] RBAC: Adding query filter params (interface=public, service_id=ecf564d4ff03470198cbafb272d51433, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:28.724931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa646ce-17c7-4252-acac-b8254d1dea2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:28.726426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa646ce-17c7-4252-acac-b8254d1dea2f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:28.729995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04016d-f723-4227-a93f-25629ebebb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:28.730665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04016d-f723-4227-a93f-25629ebebb50 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.730951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04016d-f723-4227-a93f-25629ebebb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.731258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04016d-f723-4227-a93f-25629ebebb50 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.731962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04016d-f723-4227-a93f-25629ebebb50 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:28.732272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04016d-f723-4227-a93f-25629ebebb50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:28.733707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04016d-f723-4227-a93f-25629ebebb50 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:28.736693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 501/999] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jun 21 15:45:28 2022] GET /identity/v3/endpoints?service_id=ecf564d4ff03470198cbafb272d51433&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:28.737553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa646ce-17c7-4252-acac-b8254d1dea2f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:28.743672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 499/1000] 10.222.0.46 () {56 vars in 1122 bytes} [Tue Jun 21 15:45:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:28.744554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04016d-f723-4227-a93f-25629ebebb50 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:28.847853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa646ce-17c7-4252-acac-b8254d1dea2f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:28.854045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04016d-f723-4227-a93f-25629ebebb50 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:28.890226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2a794-d19e-4c04-9538-ee8d06e6a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:28.890917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2a794-d19e-4c04-9538-ee8d06e6a575 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.891239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2a794-d19e-4c04-9538-ee8d06e6a575 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.891528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2a794-d19e-4c04-9538-ee8d06e6a575 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.892649 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2a794-d19e-4c04-9538-ee8d06e6a575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:28.894961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2a794-d19e-4c04-9538-ee8d06e6a575 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:28.897526 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3895fae-3651-4ac3-b378-ac2f745a6af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:28.898299 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895fae-3651-4ac3-b378-ac2f745a6af0 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:28.898600 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895fae-3651-4ac3-b378-ac2f745a6af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:28.898876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895fae-3651-4ac3-b378-ac2f745a6af0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:28.899657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3895fae-3651-4ac3-b378-ac2f745a6af0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:28.901085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3895fae-3651-4ac3-b378-ac2f745a6af0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:28.907284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 502/1001] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jun 21 15:45:28 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:45:28.919328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 500/1002] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jun 21 15:45:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:29.406024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845b4a5-7753-4283-8032-e6756cfcde08 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:29.406557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845b4a5-7753-4283-8032-e6756cfcde08 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:29.406557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845b4a5-7753-4283-8032-e6756cfcde08 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:29.408168 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 503/1003] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:29.414613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675031-749f-4081-be82-b09821dc87ac None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:29.415335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675031-749f-4081-be82-b09821dc87ac None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:29.415335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675031-749f-4081-be82-b09821dc87ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:29.433208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a6675031-749f-4081-be82-b09821dc87ac None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:29.434406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a6675031-749f-4081-be82-b09821dc87ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:29.488793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:29.517149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 501/1004] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:29.539579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845b4a5-7753-4283-8032-e6756cfcde08 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:29.584142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:29.659877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845b4a5-7753-4283-8032-e6756cfcde08 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:29.697811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed01cfc-a4a3-4c4e-ac99-b81592b6c787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:29.698625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed01cfc-a4a3-4c4e-ac99-b81592b6c787 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:29.698921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed01cfc-a4a3-4c4e-ac99-b81592b6c787 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:29.699245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed01cfc-a4a3-4c4e-ac99-b81592b6c787 None admin] PATH_INFO: `/v3/services/image` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:29.699923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed01cfc-a4a3-4c4e-ac99-b81592b6c787 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:29.701305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed01cfc-a4a3-4c4e-ac99-b81592b6c787 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-aed01cfc-a4a3-4c4e-ac99-b81592b6c787 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:29.714057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:29.715125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:29.716149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 504/1005] 10.222.0.46 () {56 vars in 1105 bytes} [Tue Jun 21 15:45:29 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:29.721099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6675031-749f-4081-be82-b09821dc87ac None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:29.824597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6675031-749f-4081-be82-b09821dc87ac None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:29.861728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5e22-bff1-493c-96b9-c3d8df32fef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:29.862402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5e22-bff1-493c-96b9-c3d8df32fef9 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:29.862687 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5e22-bff1-493c-96b9-c3d8df32fef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:29.862965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5e22-bff1-493c-96b9-c3d8df32fef9 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:29.863712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5e22-bff1-493c-96b9-c3d8df32fef9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:29.864020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5e22-bff1-493c-96b9-c3d8df32fef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:29.865460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5e22-bff1-493c-96b9-c3d8df32fef9 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:29.870729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 502/1006] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:29.876133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed01cfc-a4a3-4c4e-ac99-b81592b6c787 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:29.989251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:29.993327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed01cfc-a4a3-4c4e-ac99-b81592b6c787 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:30.033668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e565a3d-5bd6-4f28-81e5-d794c0ee1001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:30.034381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565a3d-5bd6-4f28-81e5-d794c0ee1001 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:30.034671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565a3d-5bd6-4f28-81e5-d794c0ee1001 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:30.034951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565a3d-5bd6-4f28-81e5-d794c0ee1001 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:30.035699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e565a3d-5bd6-4f28-81e5-d794c0ee1001 None admin] RBAC: Adding query filter params (type=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:30.036013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e565a3d-5bd6-4f28-81e5-d794c0ee1001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:30.038752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e565a3d-5bd6-4f28-81e5-d794c0ee1001 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:30.051547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 505/1007] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:31.077836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0e544-d8ff-40ce-815f-be7496dc66cf None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:31.078354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0e544-d8ff-40ce-815f-be7496dc66cf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:31.078433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0e544-d8ff-40ce-815f-be7496dc66cf None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:31.078505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faa6ef-ea9c-44a6-be82-f809a7d40346 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:31.078872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faa6ef-ea9c-44a6-be82-f809a7d40346 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:31.079221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faa6ef-ea9c-44a6-be82-f809a7d40346 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:31.079957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 503/1008] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:31.080582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 506/1009] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:31.085545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7e3a6-86ab-4ac6-b011-e4743337b19b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:31.085837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7e3a6-86ab-4ac6-b011-e4743337b19b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:31.086124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7e3a6-86ab-4ac6-b011-e4743337b19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:31.088606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281f9d-a13a-49ff-acf1-0c128ec5474f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:31.088908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281f9d-a13a-49ff-acf1-0c128ec5474f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:31.089194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281f9d-a13a-49ff-acf1-0c128ec5474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:31.103786 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c1c7e3a6-86ab-4ac6-b011-e4743337b19b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:31.105020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c1c7e3a6-86ab-4ac6-b011-e4743337b19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:31.107011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5e281f9d-a13a-49ff-acf1-0c128ec5474f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:31.108229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5e281f9d-a13a-49ff-acf1-0c128ec5474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:31.153463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:31.182123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 507/1010] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:31.184592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 504/1011] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:31.206849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e281f9d-a13a-49ff-acf1-0c128ec5474f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:31.208303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7e3a6-86ab-4ac6-b011-e4743337b19b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:31.323001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7e3a6-86ab-4ac6-b011-e4743337b19b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:31.323905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:31.333454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e281f9d-a13a-49ff-acf1-0c128ec5474f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:31.360495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fee48-a1e9-40b2-93b5-a9f29733149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:31.361403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fee48-a1e9-40b2-93b5-a9f29733149b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:31.361775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fee48-a1e9-40b2-93b5-a9f29733149b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:31.362023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fee48-a1e9-40b2-93b5-a9f29733149b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:31.362602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fee48-a1e9-40b2-93b5-a9f29733149b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:31.364195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fee48-a1e9-40b2-93b5-a9f29733149b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:31.372146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dbc38-17f5-4099-8783-76cc6230b237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:31.372948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dbc38-17f5-4099-8783-76cc6230b237 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:31.373239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dbc38-17f5-4099-8783-76cc6230b237 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:31.373519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dbc38-17f5-4099-8783-76cc6230b237 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:31.374704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dbc38-17f5-4099-8783-76cc6230b237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:31.376168 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dbc38-17f5-4099-8783-76cc6230b237 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-282fee48-a1e9-40b2-93b5-a9f29733149b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:31.377199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:31.383098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:45:31.384051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:31.384964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 508/1012] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:31.385052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 505/1013] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:31.385134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dbc38-17f5-4099-8783-76cc6230b237 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:31.387024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fee48-a1e9-40b2-93b5-a9f29733149b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:31.434010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:31.497180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dbc38-17f5-4099-8783-76cc6230b237 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:31.500475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fee48-a1e9-40b2-93b5-a9f29733149b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:31.535508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e51bb7-68f3-4031-b8fb-a7d9a9da331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:31.536182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e51bb7-68f3-4031-b8fb-a7d9a9da331e None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:31.536492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e51bb7-68f3-4031-b8fb-a7d9a9da331e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:31.536745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e51bb7-68f3-4031-b8fb-a7d9a9da331e None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:31.537337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a39b5-1e51-4e25-a9a9-784fd58ec9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:31.537656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e51bb7-68f3-4031-b8fb-a7d9a9da331e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:31.538002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a39b5-1e51-4e25-a9a9-784fd58ec9dd None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:31.538287 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a39b5-1e51-4e25-a9a9-784fd58ec9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:31.538564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a39b5-1e51-4e25-a9a9-784fd58ec9dd None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:31.539248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e51bb7-68f3-4031-b8fb-a7d9a9da331e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:31.539369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a39b5-1e51-4e25-a9a9-784fd58ec9dd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:31.539662 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a39b5-1e51-4e25-a9a9-784fd58ec9dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:31.541046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a39b5-1e51-4e25-a9a9-784fd58ec9dd None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:31.546563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 506/1014] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:31.552428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a39b5-1e51-4e25-a9a9-784fd58ec9dd None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:31.579196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 509/1015] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:45:31 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:31.667539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a39b5-1e51-4e25-a9a9-784fd58ec9dd None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:31.669312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:31.706174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15be89-5886-402c-8b16-ce45083ea977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:31.706864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15be89-5886-402c-8b16-ce45083ea977 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:31.707205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15be89-5886-402c-8b16-ce45083ea977 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:31.707496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15be89-5886-402c-8b16-ce45083ea977 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:31.708228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15be89-5886-402c-8b16-ce45083ea977 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:31.708547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15be89-5886-402c-8b16-ce45083ea977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:31.711011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15be89-5886-402c-8b16-ce45083ea977 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:31.716739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 507/1016] 10.222.0.46 () {56 vars in 1112 bytes} [Tue Jun 21 15:45:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:31.722584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e51bb7-68f3-4031-b8fb-a7d9a9da331e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:31.742444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:31.849165 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e51bb7-68f3-4031-b8fb-a7d9a9da331e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:31.888079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ff099-0ca7-4f58-8016-eb0f35751b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:31.889010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff099-0ca7-4f58-8016-eb0f35751b9e None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:31.889303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff099-0ca7-4f58-8016-eb0f35751b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:31.889587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff099-0ca7-4f58-8016-eb0f35751b9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:31.890421 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ff099-0ca7-4f58-8016-eb0f35751b9e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:31.892148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ff099-0ca7-4f58-8016-eb0f35751b9e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:31.922513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 510/1017] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jun 21 15:45:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:32.157529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61078e2-6303-4ea8-b366-f207e4059e51 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:32.158073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61078e2-6303-4ea8-b366-f207e4059e51 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:32.158073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61078e2-6303-4ea8-b366-f207e4059e51 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:32.159573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 508/1018] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:32.165290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31c151-8397-464c-985c-362bb3dea22f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:32.165745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31c151-8397-464c-985c-362bb3dea22f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:32.165851 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31c151-8397-464c-985c-362bb3dea22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:32.184865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4a31c151-8397-464c-985c-362bb3dea22f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:32.186102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4a31c151-8397-464c-985c-362bb3dea22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:32.258027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:32.270578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 511/1019] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:32 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:32.295440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61078e2-6303-4ea8-b366-f207e4059e51 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:32.403758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61078e2-6303-4ea8-b366-f207e4059e51 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:32.438275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5aba1-ef1b-4f88-a3d1-5d1244172a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:32.438868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5aba1-ef1b-4f88-a3d1-5d1244172a20 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:32.439182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5aba1-ef1b-4f88-a3d1-5d1244172a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:32.439523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5aba1-ef1b-4f88-a3d1-5d1244172a20 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:32.440268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5aba1-ef1b-4f88-a3d1-5d1244172a20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:32.441690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5aba1-ef1b-4f88-a3d1-5d1244172a20 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:32.463275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 509/1020] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:45:32 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:33.757597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d0e47-f66d-4a75-897c-83ce5aa6d051 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:33.758285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d0e47-f66d-4a75-897c-83ce5aa6d051 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:33.758285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d0e47-f66d-4a75-897c-83ce5aa6d051 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:33.759801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 512/1021] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:33.765214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266e619-be47-4d7b-8471-56b7ccd256fc None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:33.765613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266e619-be47-4d7b-8471-56b7ccd256fc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:33.765780 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266e619-be47-4d7b-8471-56b7ccd256fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:33.783636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2266e619-be47-4d7b-8471-56b7ccd256fc None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:33.784848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2266e619-be47-4d7b-8471-56b7ccd256fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:33.807481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:33.867044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 510/1022] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:33.892624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d0e47-f66d-4a75-897c-83ce5aa6d051 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:34.005700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d0e47-f66d-4a75-897c-83ce5aa6d051 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:34.041763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228b6ce-42b0-4f12-9e9b-c85817f11f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:34.042483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228b6ce-42b0-4f12-9e9b-c85817f11f12 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:34.042776 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228b6ce-42b0-4f12-9e9b-c85817f11f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:34.043059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228b6ce-42b0-4f12-9e9b-c85817f11f12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:34.044287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228b6ce-42b0-4f12-9e9b-c85817f11f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:34.045743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228b6ce-42b0-4f12-9e9b-c85817f11f12 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:34.052094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 513/1023] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:34.054251 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266e619-be47-4d7b-8471-56b7ccd256fc None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:34.145019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d90a-25b9-4c5d-a2e7-737267340dd8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:34.145319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d90a-25b9-4c5d-a2e7-737267340dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:34.145606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d90a-25b9-4c5d-a2e7-737267340dd8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:34.147264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 514/1024] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:34.153253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139c20-1b2e-4fa8-9ab2-06e226b71052 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:34.153552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139c20-1b2e-4fa8-9ab2-06e226b71052 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:34.153837 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139c20-1b2e-4fa8-9ab2-06e226b71052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:34.165991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266e619-be47-4d7b-8471-56b7ccd256fc None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:34.172311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-18139c20-1b2e-4fa8-9ab2-06e226b71052 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:34.173527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-18139c20-1b2e-4fa8-9ab2-06e226b71052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:34.206489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38045d-85dd-480e-8a56-1c2e804ea55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:34.207323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38045d-85dd-480e-8a56-1c2e804ea55b None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:34.207682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38045d-85dd-480e-8a56-1c2e804ea55b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:34.207967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38045d-85dd-480e-8a56-1c2e804ea55b None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:34.208678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38045d-85dd-480e-8a56-1c2e804ea55b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:34.210392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38045d-85dd-480e-8a56-1c2e804ea55b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:34.235187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 511/1025] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:45:34 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:34.257437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:34.268448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 515/1026] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:34.293957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38045d-85dd-480e-8a56-1c2e804ea55b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:34.306384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:34.418321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38045d-85dd-480e-8a56-1c2e804ea55b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:34.455062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd681aa-3556-4882-a0d1-a4fcc38eb0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:34.455902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd681aa-3556-4882-a0d1-a4fcc38eb0ac None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:34.456186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd681aa-3556-4882-a0d1-a4fcc38eb0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:34.456466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd681aa-3556-4882-a0d1-a4fcc38eb0ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:34.469764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd681aa-3556-4882-a0d1-a4fcc38eb0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9dd681aa-3556-4882-a0d1-a4fcc38eb0ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:34.478897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:34.480028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:34.480909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 512/1027] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jun 21 15:45:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:34.486556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139c20-1b2e-4fa8-9ab2-06e226b71052 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:34.547823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112c388-c520-4b7f-b7e3-5839106a16b6 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:34.548040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112c388-c520-4b7f-b7e3-5839106a16b6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:34.548329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112c388-c520-4b7f-b7e3-5839106a16b6 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:34.549701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 513/1028] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:34.554656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fad70-613d-4d47-b6c0-c4bd9d3ca687 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:34.554954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fad70-613d-4d47-b6c0-c4bd9d3ca687 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:34.555283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fad70-613d-4d47-b6c0-c4bd9d3ca687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:34.572417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2b4fad70-613d-4d47-b6c0-c4bd9d3ca687 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:34.573651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2b4fad70-613d-4d47-b6c0-c4bd9d3ca687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:34.604042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139c20-1b2e-4fa8-9ab2-06e226b71052 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:34.648131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429f1b1-809a-4e6b-8755-5f193aaa9443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:34.648811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:34.649577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429f1b1-809a-4e6b-8755-5f193aaa9443 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:34.650095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429f1b1-809a-4e6b-8755-5f193aaa9443 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:34.650421 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429f1b1-809a-4e6b-8755-5f193aaa9443 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:34.651289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429f1b1-809a-4e6b-8755-5f193aaa9443 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:34.651627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429f1b1-809a-4e6b-8755-5f193aaa9443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:34.653017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429f1b1-809a-4e6b-8755-5f193aaa9443 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:34.656199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 514/1029] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:34.667251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 516/1030] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jun 21 15:45:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:34.668064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fad70-613d-4d47-b6c0-c4bd9d3ca687 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:34.681109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429f1b1-809a-4e6b-8755-5f193aaa9443 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:34.743720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:34.777596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fad70-613d-4d47-b6c0-c4bd9d3ca687 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:34.799217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429f1b1-809a-4e6b-8755-5f193aaa9443 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:34.815357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980130b3-ec2c-4930-a772-d7d3f5d62f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:34.816169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980130b3-ec2c-4930-a772-d7d3f5d62f30 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:34.816463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980130b3-ec2c-4930-a772-d7d3f5d62f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:34.816763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980130b3-ec2c-4930-a772-d7d3f5d62f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:34.827686 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980130b3-ec2c-4930-a772-d7d3f5d62f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:34.829159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980130b3-ec2c-4930-a772-d7d3f5d62f30 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:34.838016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3ddaf-b187-4394-b688-18695b8c0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:34.839056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3ddaf-b187-4394-b688-18695b8c0836 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:34.839442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3ddaf-b187-4394-b688-18695b8c0836 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:34.839723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3ddaf-b187-4394-b688-18695b8c0836 None admin] PATH_INFO: `/v3/services/image` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:34.840374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3ddaf-b187-4394-b688-18695b8c0836 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:34.841734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3ddaf-b187-4394-b688-18695b8c0836 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-980130b3-ec2c-4930-a772-d7d3f5d62f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:34.847313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:34.848243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:34.849284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:34.849284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:34.849284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:34.849284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:34.849284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 515/1031] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:34.855255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980130b3-ec2c-4930-a772-d7d3f5d62f30 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4ba3ddaf-b187-4394-b688-18695b8c0836 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:34.859273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:34.860290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:34.861154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 517/1032] 10.222.0.46 () {56 vars in 1105 bytes} [Tue Jun 21 15:45:34 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:34.871249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3ddaf-b187-4394-b688-18695b8c0836 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:34.925535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:34.984834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980130b3-ec2c-4930-a772-d7d3f5d62f30 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:34.987853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3ddaf-b187-4394-b688-18695b8c0836 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:35.010189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:35.026588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7d3d3-e8fe-4ec7-a230-7e659a4f35ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:35.026789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f701f-53af-4693-ba31-34014c25c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:35.027281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7d3d3-e8fe-4ec7-a230-7e659a4f35ee None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:35.027389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f701f-53af-4693-ba31-34014c25c58d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:35.027572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7d3d3-e8fe-4ec7-a230-7e659a4f35ee None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:35.027668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f701f-53af-4693-ba31-34014c25c58d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:35.027933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7d3d3-e8fe-4ec7-a230-7e659a4f35ee None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:35.028046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f701f-53af-4693-ba31-34014c25c58d None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:35.028656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7d3d3-e8fe-4ec7-a230-7e659a4f35ee None admin] RBAC: Adding query filter params (name=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:35.028754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f701f-53af-4693-ba31-34014c25c58d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:35.028971 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7d3d3-e8fe-4ec7-a230-7e659a4f35ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:35.029068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f701f-53af-4693-ba31-34014c25c58d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:35.030354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7d3d3-e8fe-4ec7-a230-7e659a4f35ee None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:35.030455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f701f-53af-4693-ba31-34014c25c58d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:35.036083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 518/1033] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:35.041784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7d3d3-e8fe-4ec7-a230-7e659a4f35ee None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:35.047410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 516/1034] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:35.048459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f701f-53af-4693-ba31-34014c25c58d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:35.156193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7d3d3-e8fe-4ec7-a230-7e659a4f35ee None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:35.158742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f701f-53af-4693-ba31-34014c25c58d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:35.169695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:35.195719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a086b-2958-4662-988a-26211ad7e2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:35.196704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a086b-2958-4662-988a-26211ad7e2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:35.197179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a086b-2958-4662-988a-26211ad7e2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:35.197645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a086b-2958-4662-988a-26211ad7e2a2 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:35.198476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344074e7-e45e-4fb3-8568-80c48017fc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:35.198757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a086b-2958-4662-988a-26211ad7e2a2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:35.199270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a086b-2958-4662-988a-26211ad7e2a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:35.199376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344074e7-e45e-4fb3-8568-80c48017fc3b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:35.199585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344074e7-e45e-4fb3-8568-80c48017fc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:35.199868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344074e7-e45e-4fb3-8568-80c48017fc3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:35.201324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a086b-2958-4662-988a-26211ad7e2a2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:35.206449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 519/1035] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:35.208973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344074e7-e45e-4fb3-8568-80c48017fc3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:35.210693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344074e7-e45e-4fb3-8568-80c48017fc3b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:35.212521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a086b-2958-4662-988a-26211ad7e2a2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-344074e7-e45e-4fb3-8568-80c48017fc3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:35.226158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:35.227344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:35.228565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:35.228565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:35.228565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:35.228565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:35.228565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:35.228565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:35.228565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:35.228565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:35.228565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:45:35.228565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:35.230776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 517/1036] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jun 21 15:45:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:35.235965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344074e7-e45e-4fb3-8568-80c48017fc3b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:35.271430 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:35.331943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a086b-2958-4662-988a-26211ad7e2a2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:35.345648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344074e7-e45e-4fb3-8568-80c48017fc3b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:35.372143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906901d-9dc6-4615-8740-12fe049d3026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:35.373548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906901d-9dc6-4615-8740-12fe049d3026 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:35.373548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906901d-9dc6-4615-8740-12fe049d3026 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:35.373548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906901d-9dc6-4615-8740-12fe049d3026 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:35.374111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906901d-9dc6-4615-8740-12fe049d3026 None admin] RBAC: Adding query filter params (interface=public, service_id=08fe46650bc1414db7d8f365f830658e, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:35.374429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906901d-9dc6-4615-8740-12fe049d3026 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:35.375843 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906901d-9dc6-4615-8740-12fe049d3026 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:35.382460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 520/1037] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jun 21 15:45:35 2022] GET /identity/v3/endpoints?service_id=08fe46650bc1414db7d8f365f830658e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:35.388121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906901d-9dc6-4615-8740-12fe049d3026 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:35.393911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1326845-ceed-4dc8-9764-0bdb0e73142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:35.394597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1326845-ceed-4dc8-9764-0bdb0e73142e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:35.394886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1326845-ceed-4dc8-9764-0bdb0e73142e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:35.395228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1326845-ceed-4dc8-9764-0bdb0e73142e None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:35.396041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1326845-ceed-4dc8-9764-0bdb0e73142e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:35.396991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1326845-ceed-4dc8-9764-0bdb0e73142e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:35.398343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1326845-ceed-4dc8-9764-0bdb0e73142e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:35.419746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 518/1038] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jun 21 15:45:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:35.425430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1326845-ceed-4dc8-9764-0bdb0e73142e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:35.454775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:35.510300 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906901d-9dc6-4615-8740-12fe049d3026 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:35.523994 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:35.540815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1326845-ceed-4dc8-9764-0bdb0e73142e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:35.546853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf1da5-8f30-4e8b-b334-b9bd86398ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:35.547684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf1da5-8f30-4e8b-b334-b9bd86398ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:35.548074 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf1da5-8f30-4e8b-b334-b9bd86398ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:35.548457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf1da5-8f30-4e8b-b334-b9bd86398ce9 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:35.549263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf1da5-8f30-4e8b-b334-b9bd86398ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:35.550727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf1da5-8f30-4e8b-b334-b9bd86398ce9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:35.567195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 521/1039] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jun 21 15:45:35 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:45:35.590585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531c785-77ab-4bc7-9da0-db8c7d66cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:35.591424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531c785-77ab-4bc7-9da0-db8c7d66cf59 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:35.591789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531c785-77ab-4bc7-9da0-db8c7d66cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:35.592146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531c785-77ab-4bc7-9da0-db8c7d66cf59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:35.671612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531c785-77ab-4bc7-9da0-db8c7d66cf59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:35.673082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531c785-77ab-4bc7-9da0-db8c7d66cf59 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:35.704250 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:35.784350 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 519/1040] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 15:45:35.790691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf1da5-8f30-4e8b-b334-b9bd86398ce9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:35.896977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf1da5-8f30-4e8b-b334-b9bd86398ce9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:35.933670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45a4d9-d775-4cf6-8fbf-873bdf691531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:35.934440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45a4d9-d775-4cf6-8fbf-873bdf691531 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:35.934775 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45a4d9-d775-4cf6-8fbf-873bdf691531 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:35.935084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45a4d9-d775-4cf6-8fbf-873bdf691531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:35.950376 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45a4d9-d775-4cf6-8fbf-873bdf691531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:35.951856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45a4d9-d775-4cf6-8fbf-873bdf691531 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2e45a4d9-d775-4cf6-8fbf-873bdf691531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:35.969167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:35.970104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:35.971122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:35.971122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:35.971122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:35.971122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:35.975022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 522/1041] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:35.976064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531c785-77ab-4bc7-9da0-db8c7d66cf59 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:36.079969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531c785-77ab-4bc7-9da0-db8c7d66cf59 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:36.106478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:36.115680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023d00d-1e0f-4be2-a11e-a284646ebd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:36.116439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023d00d-1e0f-4be2-a11e-a284646ebd1a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:36.116633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023d00d-1e0f-4be2-a11e-a284646ebd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:36.116906 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023d00d-1e0f-4be2-a11e-a284646ebd1a None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:36.117684 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023d00d-1e0f-4be2-a11e-a284646ebd1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:36.117993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023d00d-1e0f-4be2-a11e-a284646ebd1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:36.119492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023d00d-1e0f-4be2-a11e-a284646ebd1a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:36.131828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 520/1042] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:36.137205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45a4d9-d775-4cf6-8fbf-873bdf691531 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:36.166844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:36.240111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45a4d9-d775-4cf6-8fbf-873bdf691531 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:36.274672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96b45b-8d72-46a1-bb5b-4c4cecc550be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:36.275502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96b45b-8d72-46a1-bb5b-4c4cecc550be None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:36.275787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96b45b-8d72-46a1-bb5b-4c4cecc550be None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:36.276062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96b45b-8d72-46a1-bb5b-4c4cecc550be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:36.283203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96b45b-8d72-46a1-bb5b-4c4cecc550be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:36.284645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96b45b-8d72-46a1-bb5b-4c4cecc550be None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8c96b45b-8d72-46a1-bb5b-4c4cecc550be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:36.299910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:36.300838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:36.301737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:36.301737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:36.301737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:36.301737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:36.301737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:36.301737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:36.301737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:36.301737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:36.304241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 523/1043] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:36.308630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023d00d-1e0f-4be2-a11e-a284646ebd1a None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:36.409371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023d00d-1e0f-4be2-a11e-a284646ebd1a None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:36.445917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632b314-86ca-4833-871d-b6d35f50dc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:36.446584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632b314-86ca-4833-871d-b6d35f50dc2c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:36.446869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632b314-86ca-4833-871d-b6d35f50dc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:36.447146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632b314-86ca-4833-871d-b6d35f50dc2c None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:36.447993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632b314-86ca-4833-871d-b6d35f50dc2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:36.448300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632b314-86ca-4833-871d-b6d35f50dc2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:36.449731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632b314-86ca-4833-871d-b6d35f50dc2c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:36.455504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ad16-9ccd-4bec-bae2-51e316f07415 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:36.455803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ad16-9ccd-4bec-bae2-51e316f07415 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:36.456081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ad16-9ccd-4bec-bae2-51e316f07415 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:36.457753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 524/1044] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:36.462776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 521/1045] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:36.463023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be983e9-5ea0-44ee-a522-c3a28c05e459 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:36.463319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be983e9-5ea0-44ee-a522-c3a28c05e459 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:36.463600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be983e9-5ea0-44ee-a522-c3a28c05e459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:36.468541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632b314-86ca-4833-871d-b6d35f50dc2c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:36.482042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9be983e9-5ea0-44ee-a522-c3a28c05e459 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:36.483285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9be983e9-5ea0-44ee-a522-c3a28c05e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:36.530673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:36.559566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 525/1046] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:36.583264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be983e9-5ea0-44ee-a522-c3a28c05e459 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:36.589930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632b314-86ca-4833-871d-b6d35f50dc2c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:36.603794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:36.628689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d1e34-3091-4616-af25-463a5d81f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:36.629652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d1e34-3091-4616-af25-463a5d81f8bb None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:36.629768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d1e34-3091-4616-af25-463a5d81f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:36.630030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d1e34-3091-4616-af25-463a5d81f8bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:36.631603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d1e34-3091-4616-af25-463a5d81f8bb None admin] RBAC: Adding query filter params (role.id=72d7841f0705491c9a7d4a2679d94457, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2ab989a935eb4d91a94611cededd3cf6) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:36.632364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d1e34-3091-4616-af25-463a5d81f8bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:36.633728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d1e34-3091-4616-af25-463a5d81f8bb None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:36.647696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 522/1047] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:36 2022] GET /identity/v3/role_assignments?user.id=2ab989a935eb4d91a94611cededd3cf6&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=72d7841f0705491c9a7d4a2679d94457 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:36.709724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be983e9-5ea0-44ee-a522-c3a28c05e459 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:36.750284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dff78-1542-4a9d-a14e-71708cfba11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:36.751098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dff78-1542-4a9d-a14e-71708cfba11b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:36.751415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dff78-1542-4a9d-a14e-71708cfba11b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:36.751695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dff78-1542-4a9d-a14e-71708cfba11b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:36.766036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dff78-1542-4a9d-a14e-71708cfba11b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-278dff78-1542-4a9d-a14e-71708cfba11b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:36.780175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:36.781276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:36.782127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:36.788417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 526/1048] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:36.792329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d1e34-3091-4616-af25-463a5d81f8bb None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:36.901831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d1e34-3091-4616-af25-463a5d81f8bb None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:36.917101 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:36.946077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befcb04-322b-4544-99b4-152058105d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:36.946761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befcb04-322b-4544-99b4-152058105d84 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:36.947051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befcb04-322b-4544-99b4-152058105d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:36.947458 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befcb04-322b-4544-99b4-152058105d84 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:36.948261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befcb04-322b-4544-99b4-152058105d84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:36.948580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befcb04-322b-4544-99b4-152058105d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:36.949959 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befcb04-322b-4544-99b4-152058105d84 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:36.959683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 523/1049] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:45:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:36.965230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dff78-1542-4a9d-a14e-71708cfba11b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:37.058294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:37.081868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dff78-1542-4a9d-a14e-71708cfba11b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:37.119046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5638-f5c5-4499-8f87-60f3fad93682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:37.119948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5638-f5c5-4499-8f87-60f3fad93682 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:37.120345 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5638-f5c5-4499-8f87-60f3fad93682 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:37.120497 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5638-f5c5-4499-8f87-60f3fad93682 None admin] PATH_INFO: `/v3/users/a944bad8a1f94524a4a553beaca4a440` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:37.135200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f5638-f5c5-4499-8f87-60f3fad93682 None admin] RBAC: Authorizing `identity:get_user(user_id=a944bad8a1f94524a4a553beaca4a440)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:37.136654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f5638-f5c5-4499-8f87-60f3fad93682 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:37.138790 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 527/1050] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:45:36 2022] GET /identity/v3/users/a944bad8a1f94524a4a553beaca4a440 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:37.144355 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befcb04-322b-4544-99b4-152058105d84 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:37.251046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befcb04-322b-4544-99b4-152058105d84 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:37.288626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576e0e2-58af-4822-8d59-421a640984b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:37.289282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576e0e2-58af-4822-8d59-421a640984b2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:37.289573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576e0e2-58af-4822-8d59-421a640984b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:37.289858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576e0e2-58af-4822-8d59-421a640984b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:37.335612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:37.364054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576e0e2-58af-4822-8d59-421a640984b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:37.365764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576e0e2-58af-4822-8d59-421a640984b2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:37.473242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 524/1051] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:45:37.480305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5638-f5c5-4499-8f87-60f3fad93682 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:37.585054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5638-f5c5-4499-8f87-60f3fad93682 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:37.621371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca764698-bdc5-4cdf-972c-5ed42448e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:37.622171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca764698-bdc5-4cdf-972c-5ed42448e2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:37.622460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca764698-bdc5-4cdf-972c-5ed42448e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:37.622745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca764698-bdc5-4cdf-972c-5ed42448e2d6 None admin] PATH_INFO: `/v3/projects/0921a4780de74b4c94a8a816cea03bdd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:37.624001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca764698-bdc5-4cdf-972c-5ed42448e2d6 None admin] RBAC: Authorizing `identity:get_project(project_id=0921a4780de74b4c94a8a816cea03bdd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:37.625444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca764698-bdc5-4cdf-972c-5ed42448e2d6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:37.631389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 528/1052] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:45:37 2022] GET /identity/v3/projects/0921a4780de74b4c94a8a816cea03bdd => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:37.633629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576e0e2-58af-4822-8d59-421a640984b2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:37.705296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ab947-a1da-45c8-904b-f17ed81c4fd2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:37.705296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ab947-a1da-45c8-904b-f17ed81c4fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:37.705296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ab947-a1da-45c8-904b-f17ed81c4fd2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:37.705296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 529/1053] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:45:37.711042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4ba65-3a52-41b0-8d74-a00c733dc5d2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:37.711413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4ba65-3a52-41b0-8d74-a00c733dc5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:37.711694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4ba65-3a52-41b0-8d74-a00c733dc5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:37.717998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:37.722952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:37.730593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7ef4ba65-3a52-41b0-8d74-a00c733dc5d2 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:37.731946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7ef4ba65-3a52-41b0-8d74-a00c733dc5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:37.756417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576e0e2-58af-4822-8d59-421a640984b2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:37.797695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40d486-ff86-400a-a959-51e2ea21e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:37.798448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40d486-ff86-400a-a959-51e2ea21e5ae None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:37.798635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40d486-ff86-400a-a959-51e2ea21e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:37.798982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40d486-ff86-400a-a959-51e2ea21e5ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:37.799938 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40d486-ff86-400a-a959-51e2ea21e5ae None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=0921a4780de74b4c94a8a816cea03bdd, user.id=a944bad8a1f94524a4a553beaca4a440) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:37.800259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40d486-ff86-400a-a959-51e2ea21e5ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:37.801687 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40d486-ff86-400a-a959-51e2ea21e5ae None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:37.807262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 530/1054] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:37.811193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 525/1055] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:37 2022] GET /identity/v3/role_assignments?user.id=a944bad8a1f94524a4a553beaca4a440&scope.project.id=0921a4780de74b4c94a8a816cea03bdd&role.id=29dae918965d40bea71d83ffa2085316 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:37.832444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4ba65-3a52-41b0-8d74-a00c733dc5d2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:37.955328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4ba65-3a52-41b0-8d74-a00c733dc5d2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:38.004560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cf38a-9e30-4a1e-ace0-0ad2040e1791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:38.005367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cf38a-9e30-4a1e-ace0-0ad2040e1791 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:38.005708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cf38a-9e30-4a1e-ace0-0ad2040e1791 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:38.005986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cf38a-9e30-4a1e-ace0-0ad2040e1791 None admin] PATH_INFO: `/v3/services/image` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:38.006804 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cf38a-9e30-4a1e-ace0-0ad2040e1791 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:38.008378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cf38a-9e30-4a1e-ace0-0ad2040e1791 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:38.010614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-227cf38a-9e30-4a1e-ace0-0ad2040e1791 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:38.024222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:38.025263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:45:38.026112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:38.030455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 531/1056] 10.222.0.46 () {56 vars in 1105 bytes} [Tue Jun 21 15:45:37 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:38.031575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40d486-ff86-400a-a959-51e2ea21e5ae None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:38.143873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40d486-ff86-400a-a959-51e2ea21e5ae None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:38.191708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142c56-a1fa-4f29-bbf6-ef1b3fa31927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:38.192356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142c56-a1fa-4f29-bbf6-ef1b3fa31927 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:38.192650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142c56-a1fa-4f29-bbf6-ef1b3fa31927 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:38.192935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142c56-a1fa-4f29-bbf6-ef1b3fa31927 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:38.193831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e142c56-a1fa-4f29-bbf6-ef1b3fa31927 None admin] RBAC: Adding query filter params (name=image) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:38.194154 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e142c56-a1fa-4f29-bbf6-ef1b3fa31927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:38.195588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e142c56-a1fa-4f29-bbf6-ef1b3fa31927 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:38.203420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 526/1057] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:38.212994 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cf38a-9e30-4a1e-ace0-0ad2040e1791 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:38.321554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cf38a-9e30-4a1e-ace0-0ad2040e1791 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:38.358592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab570d49-8f73-4faf-9f68-7b500e4e3c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:38.359293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab570d49-8f73-4faf-9f68-7b500e4e3c9b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:38.359582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab570d49-8f73-4faf-9f68-7b500e4e3c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:38.359860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab570d49-8f73-4faf-9f68-7b500e4e3c9b None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:38.360629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab570d49-8f73-4faf-9f68-7b500e4e3c9b None admin] RBAC: Adding query filter params (type=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:38.360942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab570d49-8f73-4faf-9f68-7b500e4e3c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:38.362307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab570d49-8f73-4faf-9f68-7b500e4e3c9b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:38.367834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 532/1058] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:38.373279 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142c56-a1fa-4f29-bbf6-ef1b3fa31927 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:38.376137 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:38.485850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142c56-a1fa-4f29-bbf6-ef1b3fa31927 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:38.524388 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5aa5e-dec9-48b7-9a19-9683dfff9f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:38.525062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5aa5e-dec9-48b7-9a19-9683dfff9f65 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:38.525352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5aa5e-dec9-48b7-9a19-9683dfff9f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:38.525636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5aa5e-dec9-48b7-9a19-9683dfff9f65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:38.526404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5aa5e-dec9-48b7-9a19-9683dfff9f65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:38.527887 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5aa5e-dec9-48b7-9a19-9683dfff9f65 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:38.548599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 527/1059] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jun 21 15:45:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:38.765378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf590f-785d-476f-b74a-37a33be84f54 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:38.765675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf590f-785d-476f-b74a-37a33be84f54 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:38.765860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf590f-785d-476f-b74a-37a33be84f54 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:38.767400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 533/1060] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:38.773786 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce8088-004c-4975-839d-28e350e96fb5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:38.774086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce8088-004c-4975-839d-28e350e96fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:38.774371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce8088-004c-4975-839d-28e350e96fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:38.793158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-62ce8088-004c-4975-839d-28e350e96fb5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:38.794364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-62ce8088-004c-4975-839d-28e350e96fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:38.855422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:38.887285 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 528/1061] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:38.915323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf590f-785d-476f-b74a-37a33be84f54 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:38.987693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:39.036602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf590f-785d-476f-b74a-37a33be84f54 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:39.086053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd4e3b-29e4-4db5-be39-6e06a7ef0819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:39.086897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd4e3b-29e4-4db5-be39-6e06a7ef0819 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:39.087210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd4e3b-29e4-4db5-be39-6e06a7ef0819 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:39.087502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd4e3b-29e4-4db5-be39-6e06a7ef0819 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:39.100308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd4e3b-29e4-4db5-be39-6e06a7ef0819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0afd4e3b-29e4-4db5-be39-6e06a7ef0819 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:39.108928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:39.109897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:39.116631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 534/1062] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jun 21 15:45:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:39.119304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce8088-004c-4975-839d-28e350e96fb5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:39.233886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce8088-004c-4975-839d-28e350e96fb5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:39.279478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd3ebf-5651-4a76-ae30-314a18713332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:39.280155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd3ebf-5651-4a76-ae30-314a18713332 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:39.280446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd3ebf-5651-4a76-ae30-314a18713332 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:39.280729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd3ebf-5651-4a76-ae30-314a18713332 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:39.281481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd3ebf-5651-4a76-ae30-314a18713332 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:39.281794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd3ebf-5651-4a76-ae30-314a18713332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:39.283179 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd3ebf-5651-4a76-ae30-314a18713332 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:39.296917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 529/1063] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jun 21 15:45:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:39.298722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd4e3b-29e4-4db5-be39-6e06a7ef0819 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:39.404174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd4e3b-29e4-4db5-be39-6e06a7ef0819 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:39.433183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:39.447324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a627-55f3-4288-94bb-5e0776f60e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:39.448226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a627-55f3-4288-94bb-5e0776f60e49 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:39.448513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a627-55f3-4288-94bb-5e0776f60e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:39.448782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a627-55f3-4288-94bb-5e0776f60e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:39.459451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703a627-55f3-4288-94bb-5e0776f60e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:39.460755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703a627-55f3-4288-94bb-5e0776f60e49 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b703a627-55f3-4288-94bb-5e0776f60e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:39.478769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:39.479921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:39.485828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:39.485828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:39.485828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:39.485828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:39.485828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 535/1064] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:39.487631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd3ebf-5651-4a76-ae30-314a18713332 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:39.543981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:39.602910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd3ebf-5651-4a76-ae30-314a18713332 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:39.640460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f671-0a3d-41a2-b87e-142277da4436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:39.641141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f671-0a3d-41a2-b87e-142277da4436 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:39.641428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f671-0a3d-41a2-b87e-142277da4436 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:39.641710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365f671-0a3d-41a2-b87e-142277da4436 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:39.642446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365f671-0a3d-41a2-b87e-142277da4436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:39.642754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365f671-0a3d-41a2-b87e-142277da4436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:39.644163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365f671-0a3d-41a2-b87e-142277da4436 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:39.663444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 530/1065] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:39.664760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a627-55f3-4288-94bb-5e0776f60e49 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:39.775972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a627-55f3-4288-94bb-5e0776f60e49 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:39.813937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2eb58-9a85-4180-91d3-d19ac95b6db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:39.814741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2eb58-9a85-4180-91d3-d19ac95b6db8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:39.815024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2eb58-9a85-4180-91d3-d19ac95b6db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:39.815335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2eb58-9a85-4180-91d3-d19ac95b6db8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:39.823373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2eb58-9a85-4180-91d3-d19ac95b6db8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:39.824830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2eb58-9a85-4180-91d3-d19ac95b6db8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9cd2eb58-9a85-4180-91d3-d19ac95b6db8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:39.840077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:39.841025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:39.842005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 536/1066] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jun 21 15:45:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:39.848576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f671-0a3d-41a2-b87e-142277da4436 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:39.900656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5c06a-f86a-422b-8f52-89aadfad5649 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:39.900907 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5c06a-f86a-422b-8f52-89aadfad5649 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:39.901142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5c06a-f86a-422b-8f52-89aadfad5649 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:39.902781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 537/1067] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:39.908101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b8f4c-b5d7-4c33-9e42-fdccd9633893 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:39.908547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b8f4c-b5d7-4c33-9e42-fdccd9633893 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:39.908838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b8f4c-b5d7-4c33-9e42-fdccd9633893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:39.930302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c03b8f4c-b5d7-4c33-9e42-fdccd9633893 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:39.931565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c03b8f4c-b5d7-4c33-9e42-fdccd9633893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:39.963324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:39.970308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365f671-0a3d-41a2-b87e-142277da4436 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:39.979679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:40.009477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 538/1068] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:40.013349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552ab5b-dc32-4821-af2a-2ac2da532a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:40.014502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552ab5b-dc32-4821-af2a-2ac2da532a0f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.014991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552ab5b-dc32-4821-af2a-2ac2da532a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.015491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552ab5b-dc32-4821-af2a-2ac2da532a0f None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.016567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552ab5b-dc32-4821-af2a-2ac2da532a0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:40.017083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552ab5b-dc32-4821-af2a-2ac2da532a0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:40.018701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552ab5b-dc32-4821-af2a-2ac2da532a0f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:40.033090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b8f4c-b5d7-4c33-9e42-fdccd9633893 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:40.038698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 531/1069] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jun 21 15:45:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:40.044635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552ab5b-dc32-4821-af2a-2ac2da532a0f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:40.157574 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b8f4c-b5d7-4c33-9e42-fdccd9633893 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:40.158666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552ab5b-dc32-4821-af2a-2ac2da532a0f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:40.197804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73394d1-dd51-4ed2-ac1f-e4309f2e63f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:40.198169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88fe26-f1df-4844-b22f-d1f4c51d6861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:40.198613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73394d1-dd51-4ed2-ac1f-e4309f2e63f3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.198899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73394d1-dd51-4ed2-ac1f-e4309f2e63f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.198997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88fe26-f1df-4844-b22f-d1f4c51d6861 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.199205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73394d1-dd51-4ed2-ac1f-e4309f2e63f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.199319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88fe26-f1df-4844-b22f-d1f4c51d6861 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.199490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88fe26-f1df-4844-b22f-d1f4c51d6861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.210338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88fe26-f1df-4844-b22f-d1f4c51d6861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:40.210658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73394d1-dd51-4ed2-ac1f-e4309f2e63f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:40.212131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73394d1-dd51-4ed2-ac1f-e4309f2e63f3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ce88fe26-f1df-4844-b22f-d1f4c51d6861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:40.218361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:40.219568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:45:40.221170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 539/1070] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:45:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:40.226220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88fe26-f1df-4844-b22f-d1f4c51d6861 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f73394d1-dd51-4ed2-ac1f-e4309f2e63f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:40.233288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:40.234216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:40.241493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:40.241493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:40.241493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:40.241493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:40.241493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 532/1071] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:40.241493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73394d1-dd51-4ed2-ac1f-e4309f2e63f3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:40.258054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:40.261964 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:40.342424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88fe26-f1df-4844-b22f-d1f4c51d6861 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:40.355025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73394d1-dd51-4ed2-ac1f-e4309f2e63f3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:40.381684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078171a-6b98-4d4e-94b0-83830eade0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:40.382368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078171a-6b98-4d4e-94b0-83830eade0ce None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.382651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078171a-6b98-4d4e-94b0-83830eade0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.382927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078171a-6b98-4d4e-94b0-83830eade0ce None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.383710 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078171a-6b98-4d4e-94b0-83830eade0ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:40.384020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078171a-6b98-4d4e-94b0-83830eade0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:40.385395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078171a-6b98-4d4e-94b0-83830eade0ce None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:40.398979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 540/1072] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:45:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:40.404198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078171a-6b98-4d4e-94b0-83830eade0ce None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:40.406505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f9ae2-b6b6-4c8d-a324-17bd38f397ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:40.407516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f9ae2-b6b6-4c8d-a324-17bd38f397ef None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.407853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f9ae2-b6b6-4c8d-a324-17bd38f397ef None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.408201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f9ae2-b6b6-4c8d-a324-17bd38f397ef None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.408802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f9ae2-b6b6-4c8d-a324-17bd38f397ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:40.409824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f9ae2-b6b6-4c8d-a324-17bd38f397ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:40.410520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f9ae2-b6b6-4c8d-a324-17bd38f397ef None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:40.430288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 533/1073] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:40.432118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f9ae2-b6b6-4c8d-a324-17bd38f397ef None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:40.511548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:40.526987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:40.530936 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078171a-6b98-4d4e-94b0-83830eade0ce None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:40.557768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f9ae2-b6b6-4c8d-a324-17bd38f397ef None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:40.569577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295894c-3438-423e-ac4d-daa95e70def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:40.570466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295894c-3438-423e-ac4d-daa95e70def9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.570751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295894c-3438-423e-ac4d-daa95e70def9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.571027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295894c-3438-423e-ac4d-daa95e70def9 None admin] PATH_INFO: `/v3/users/a944bad8a1f94524a4a553beaca4a440` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.572373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295894c-3438-423e-ac4d-daa95e70def9 None admin] RBAC: Authorizing `identity:get_user(user_id=a944bad8a1f94524a4a553beaca4a440)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:40.574407 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295894c-3438-423e-ac4d-daa95e70def9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:40.575846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 541/1074] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:45:40 2022] GET /identity/v3/users/a944bad8a1f94524a4a553beaca4a440 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:40.581116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295894c-3438-423e-ac4d-daa95e70def9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:40.598836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8232586-979e-4414-8081-db86e966dfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:40.600553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8232586-979e-4414-8081-db86e966dfd5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.601062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8232586-979e-4414-8081-db86e966dfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.601569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8232586-979e-4414-8081-db86e966dfd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.611120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8232586-979e-4414-8081-db86e966dfd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:40.612903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8232586-979e-4414-8081-db86e966dfd5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f8232586-979e-4414-8081-db86e966dfd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:40.629139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:40.630109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:40.631132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:40.631132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:40.631132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:40.631132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:40.631132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:40.631132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:40.631132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:40.631132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:40.631132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 534/1075] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:40.636422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8232586-979e-4414-8081-db86e966dfd5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:40.698010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295894c-3438-423e-ac4d-daa95e70def9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:40.737416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e56394-1168-4345-a36b-50f15fa09c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:40.738494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e56394-1168-4345-a36b-50f15fa09c31 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.738787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e56394-1168-4345-a36b-50f15fa09c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.739263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e56394-1168-4345-a36b-50f15fa09c31 None admin] PATH_INFO: `/v3/projects/0921a4780de74b4c94a8a816cea03bdd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.740949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e56394-1168-4345-a36b-50f15fa09c31 None admin] RBAC: Authorizing `identity:get_project(project_id=0921a4780de74b4c94a8a816cea03bdd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:40.742416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e56394-1168-4345-a36b-50f15fa09c31 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:40.749877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 542/1076] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:45:40 2022] GET /identity/v3/projects/0921a4780de74b4c94a8a816cea03bdd => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:40.751153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bed45-d4a3-4b58-a1ec-7beff6cfeeaf None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.751469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bed45-d4a3-4b58-a1ec-7beff6cfeeaf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.751751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bed45-d4a3-4b58-a1ec-7beff6cfeeaf None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.753459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 543/1077] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:40.753755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bed45-d4a3-4b58-a1ec-7beff6cfeeaf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:40.756915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8232586-979e-4414-8081-db86e966dfd5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:40.781349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:40.794799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86722916-113e-4235-bc22-24d10d35c7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:40.795507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722916-113e-4235-bc22-24d10d35c7df None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.795790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722916-113e-4235-bc22-24d10d35c7df None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.796066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722916-113e-4235-bc22-24d10d35c7df None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.796856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86722916-113e-4235-bc22-24d10d35c7df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:40.797167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86722916-113e-4235-bc22-24d10d35c7df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:40.798606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86722916-113e-4235-bc22-24d10d35c7df None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:40.801303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:40.813217 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 535/1078] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:40.814589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5fdbe-569a-444b-a894-9979f1d1cff6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.814889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5fdbe-569a-444b-a894-9979f1d1cff6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.815185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5fdbe-569a-444b-a894-9979f1d1cff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.835023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-62a5fdbe-569a-444b-a894-9979f1d1cff6 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:40.836447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-62a5fdbe-569a-444b-a894-9979f1d1cff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:40.865485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bed45-d4a3-4b58-a1ec-7beff6cfeeaf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:40.904283 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96824f-07df-46a6-99b0-c964286fe49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:40.905389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96824f-07df-46a6-99b0-c964286fe49e None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:40.905608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96824f-07df-46a6-99b0-c964286fe49e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:40.906179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96824f-07df-46a6-99b0-c964286fe49e None admin] PATH_INFO: `/v3/projects/0921a4780de74b4c94a8a816cea03bdd/users/a944bad8a1f94524a4a553beaca4a440/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:40.907959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96824f-07df-46a6-99b0-c964286fe49e None admin] RBAC: Authorizing `identity:create_grant(project_id=0921a4780de74b4c94a8a816cea03bdd, user_id=a944bad8a1f94524a4a553beaca4a440, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:40.909400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96824f-07df-46a6-99b0-c964286fe49e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:40.914025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 536/1079] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:40.914857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5fdbe-569a-444b-a894-9979f1d1cff6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:40.925364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 544/1080] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:45:40 2022] PUT /identity/v3/projects/0921a4780de74b4c94a8a816cea03bdd/users/a944bad8a1f94524a4a553beaca4a440/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:45:40.940868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96824f-07df-46a6-99b0-c964286fe49e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:41.073263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:41.076947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5fdbe-569a-444b-a894-9979f1d1cff6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:41.107336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96824f-07df-46a6-99b0-c964286fe49e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:41.112815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:41.133180 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777975f-423b-4311-9bd3-e7408d85f23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:41.134428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777975f-423b-4311-9bd3-e7408d85f23d None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:41.134719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777975f-423b-4311-9bd3-e7408d85f23d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:41.135003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777975f-423b-4311-9bd3-e7408d85f23d None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2ab989a935eb4d91a94611cededd3cf6/roles/72d7841f0705491c9a7d4a2679d94457` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:41.138308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777975f-423b-4311-9bd3-e7408d85f23d None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=2ab989a935eb4d91a94611cededd3cf6, role_id=72d7841f0705491c9a7d4a2679d94457)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:41.140901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777975f-423b-4311-9bd3-e7408d85f23d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:41.149099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852d79c-86a0-474a-8297-2e66df7ba2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:41.149765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852d79c-86a0-474a-8297-2e66df7ba2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:41.150180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852d79c-86a0-474a-8297-2e66df7ba2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:41.150504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852d79c-86a0-474a-8297-2e66df7ba2d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:41.163211 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 537/1081] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:45:40 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2ab989a935eb4d91a94611cededd3cf6/roles/72d7841f0705491c9a7d4a2679d94457 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:45:41.247540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852d79c-86a0-474a-8297-2e66df7ba2d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:41.248940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852d79c-86a0-474a-8297-2e66df7ba2d1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:41.347942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:41.369803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 545/1082] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 15:45:41.375966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777975f-423b-4311-9bd3-e7408d85f23d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:41.488827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777975f-423b-4311-9bd3-e7408d85f23d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:41.524522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8d244-c705-4d8f-8cb6-d9ebd2645ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:41.525321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8d244-c705-4d8f-8cb6-d9ebd2645ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:41.525633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8d244-c705-4d8f-8cb6-d9ebd2645ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:41.525907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8d244-c705-4d8f-8cb6-d9ebd2645ca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:41.536334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8d244-c705-4d8f-8cb6-d9ebd2645ca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:41.538310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8d244-c705-4d8f-8cb6-d9ebd2645ca8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-d6b8d244-c705-4d8f-8cb6-d9ebd2645ca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:41.556827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:41.557793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:41.558697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:41.558697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:41.558697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:41.558697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:41.563086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 538/1083] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:41.564516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852d79c-86a0-474a-8297-2e66df7ba2d1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:41.672984 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852d79c-86a0-474a-8297-2e66df7ba2d1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:41.709485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f5350-7aee-46af-b5fc-ed935219999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:41.710167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f5350-7aee-46af-b5fc-ed935219999b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:41.710454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f5350-7aee-46af-b5fc-ed935219999b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:41.710729 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f5350-7aee-46af-b5fc-ed935219999b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:41.711497 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f5350-7aee-46af-b5fc-ed935219999b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:41.711808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f5350-7aee-46af-b5fc-ed935219999b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:41.713210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f5350-7aee-46af-b5fc-ed935219999b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:41.731199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 546/1084] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:42.999559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b16d43-6781-4e53-8ab6-a375251fc509 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.000143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b16d43-6781-4e53-8ab6-a375251fc509 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.000143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b16d43-6781-4e53-8ab6-a375251fc509 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.001536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 539/1085] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:43.007829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008a3bd-408a-4b05-9656-d14ad4d32124 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.008621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008a3bd-408a-4b05-9656-d14ad4d32124 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.008621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008a3bd-408a-4b05-9656-d14ad4d32124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.026487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f008a3bd-408a-4b05-9656-d14ad4d32124 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:43.027709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f008a3bd-408a-4b05-9656-d14ad4d32124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:43.062738 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:43.097683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 547/1086] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:43.121374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b16d43-6781-4e53-8ab6-a375251fc509 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:43.166128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:43.231045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b16d43-6781-4e53-8ab6-a375251fc509 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:43.270735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ae727-f11d-4a13-9695-1384fb54b906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:43.272137 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ae727-f11d-4a13-9695-1384fb54b906 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.272425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ae727-f11d-4a13-9695-1384fb54b906 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.272704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ae727-f11d-4a13-9695-1384fb54b906 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.283363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ae727-f11d-4a13-9695-1384fb54b906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-034ae727-f11d-4a13-9695-1384fb54b906 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:43.291307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:43.292477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:43.293439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 540/1087] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:45:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:43.298571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008a3bd-408a-4b05-9656-d14ad4d32124 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:43.299342 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e7ee7-947c-44c0-8f3e-c72ba149a369 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.299641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e7ee7-947c-44c0-8f3e-c72ba149a369 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.299929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e7ee7-947c-44c0-8f3e-c72ba149a369 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.307263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 541/1088] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:45:43.309537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097e27-a1f9-4da9-b4e6-26466840154f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.309999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097e27-a1f9-4da9-b4e6-26466840154f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.310446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097e27-a1f9-4da9-b4e6-26466840154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.335180 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-64097e27-a1f9-4da9-b4e6-26466840154f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:43.336974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-64097e27-a1f9-4da9-b4e6-26466840154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:43.409065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 542/1089] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:45:43.417654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008a3bd-408a-4b05-9656-d14ad4d32124 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:43.434752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097e27-a1f9-4da9-b4e6-26466840154f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:43.457927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14463a-c2be-4e3c-bef1-7a4944cfeaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:43.458637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14463a-c2be-4e3c-bef1-7a4944cfeaae None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.458924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14463a-c2be-4e3c-bef1-7a4944cfeaae None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.459233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14463a-c2be-4e3c-bef1-7a4944cfeaae None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.460127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14463a-c2be-4e3c-bef1-7a4944cfeaae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:43.460434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14463a-c2be-4e3c-bef1-7a4944cfeaae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:43.461813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14463a-c2be-4e3c-bef1-7a4944cfeaae None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:43.468293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:43.471501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 548/1090] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:45:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:43.477361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14463a-c2be-4e3c-bef1-7a4944cfeaae None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:43.512555 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:43.550776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097e27-a1f9-4da9-b4e6-26466840154f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:43.587616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf72cf9-ac53-4e88-966b-0f9d94e2c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:43.588439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf72cf9-ac53-4e88-966b-0f9d94e2c8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.588726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf72cf9-ac53-4e88-966b-0f9d94e2c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.589000 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf72cf9-ac53-4e88-966b-0f9d94e2c8b4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.593603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14463a-c2be-4e3c-bef1-7a4944cfeaae None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:43.601157 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf72cf9-ac53-4e88-966b-0f9d94e2c8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9bf72cf9-ac53-4e88-966b-0f9d94e2c8b4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:45:43.609941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:43.610982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:43.611899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 543/1091] 10.222.0.46 () {56 vars in 1120 bytes} [Tue Jun 21 15:45:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:43.617335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf72cf9-ac53-4e88-966b-0f9d94e2c8b4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:43.632371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eefd18-9359-413e-b55e-796612d41fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:43.633354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eefd18-9359-413e-b55e-796612d41fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.633648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eefd18-9359-413e-b55e-796612d41fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.633928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eefd18-9359-413e-b55e-796612d41fb1 None admin] PATH_INFO: `/v3/users/a944bad8a1f94524a4a553beaca4a440` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.635143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eefd18-9359-413e-b55e-796612d41fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=a944bad8a1f94524a4a553beaca4a440)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:43.636629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eefd18-9359-413e-b55e-796612d41fb1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:43.638269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 549/1092] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:45:43 2022] GET /identity/v3/users/a944bad8a1f94524a4a553beaca4a440 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:43.644413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eefd18-9359-413e-b55e-796612d41fb1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:43.711367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:43.724309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf72cf9-ac53-4e88-966b-0f9d94e2c8b4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:43.751786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eefd18-9359-413e-b55e-796612d41fb1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:43.753475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:43.758855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1d958-36bd-414e-bc3a-18acbfb0829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:43.759558 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1d958-36bd-414e-bc3a-18acbfb0829b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.759842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1d958-36bd-414e-bc3a-18acbfb0829b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.760120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1d958-36bd-414e-bc3a-18acbfb0829b None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.760870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1d958-36bd-414e-bc3a-18acbfb0829b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:43.761182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1d958-36bd-414e-bc3a-18acbfb0829b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:43.762552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1d958-36bd-414e-bc3a-18acbfb0829b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:43.772032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 544/1093] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jun 21 15:45:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:43.777699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1d958-36bd-414e-bc3a-18acbfb0829b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:43.790887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dceeb9d-0ae8-4851-b08b-fcc511c9ce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:43.791875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dceeb9d-0ae8-4851-b08b-fcc511c9ce92 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.792163 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dceeb9d-0ae8-4851-b08b-fcc511c9ce92 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.792441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dceeb9d-0ae8-4851-b08b-fcc511c9ce92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.867837 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dceeb9d-0ae8-4851-b08b-fcc511c9ce92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:43.869303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dceeb9d-0ae8-4851-b08b-fcc511c9ce92 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:43.885646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1d958-36bd-414e-bc3a-18acbfb0829b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:43.922106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7531f-a01c-4ecf-b4f7-6628ba0f99f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:43.922938 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7531f-a01c-4ecf-b4f7-6628ba0f99f1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:43.923256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7531f-a01c-4ecf-b4f7-6628ba0f99f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:43.923539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7531f-a01c-4ecf-b4f7-6628ba0f99f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:43.934809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7531f-a01c-4ecf-b4f7-6628ba0f99f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:43.936376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7531f-a01c-4ecf-b4f7-6628ba0f99f1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-2bd7531f-a01c-4ecf-b4f7-6628ba0f99f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:43.955551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:43.956586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:43.957479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:43.957479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:43.957479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:43.957479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:43.957479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 545/1094] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:43.963193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7531f-a01c-4ecf-b4f7-6628ba0f99f1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:43.966174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:43.986439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 550/1095] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 15:45:43.992450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dceeb9d-0ae8-4851-b08b-fcc511c9ce92 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:43.994453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:44.067892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7531f-a01c-4ecf-b4f7-6628ba0f99f1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:44.095848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dceeb9d-0ae8-4851-b08b-fcc511c9ce92 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:44.102568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fefc6-28ba-4a68-874b-2c1bb205cb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:44.103290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fefc6-28ba-4a68-874b-2c1bb205cb40 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:44.103573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fefc6-28ba-4a68-874b-2c1bb205cb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:44.103852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fefc6-28ba-4a68-874b-2c1bb205cb40 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:44.104592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fefc6-28ba-4a68-874b-2c1bb205cb40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:44.104900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fefc6-28ba-4a68-874b-2c1bb205cb40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:44.106289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fefc6-28ba-4a68-874b-2c1bb205cb40 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:44.120406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 546/1096] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:44.126002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fefc6-28ba-4a68-874b-2c1bb205cb40 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:44.133477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf5983-ed87-4120-ace7-70c31a661c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:44.134352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5983-ed87-4120-ace7-70c31a661c94 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:44.134635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5983-ed87-4120-ace7-70c31a661c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:44.134912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5983-ed87-4120-ace7-70c31a661c94 None admin] PATH_INFO: `/v3/projects/0921a4780de74b4c94a8a816cea03bdd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:44.136314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf5983-ed87-4120-ace7-70c31a661c94 None admin] RBAC: Authorizing `identity:get_project(project_id=0921a4780de74b4c94a8a816cea03bdd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:44.137762 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf5983-ed87-4120-ace7-70c31a661c94 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:44.139768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 551/1097] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:45:43 2022] GET /identity/v3/projects/0921a4780de74b4c94a8a816cea03bdd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:44.147033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf5983-ed87-4120-ace7-70c31a661c94 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:44.191127 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:44.231566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fefc6-28ba-4a68-874b-2c1bb205cb40 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:44.243321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:44.270207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfdaf8-6951-424e-b4de-1cc2581757c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:44.271545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfdaf8-6951-424e-b4de-1cc2581757c8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:44.271833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfdaf8-6951-424e-b4de-1cc2581757c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:44.272507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfdaf8-6951-424e-b4de-1cc2581757c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:44.280905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfdaf8-6951-424e-b4de-1cc2581757c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:44.282382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfdaf8-6951-424e-b4de-1cc2581757c8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:44.284759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf5983-ed87-4120-ace7-70c31a661c94 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-59bfdaf8-6951-424e-b4de-1cc2581757c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:45:44.298568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:44.299770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:44.300909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 547/1098] 10.222.0.46 () {56 vars in 1093 bytes} [Tue Jun 21 15:45:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:44.306327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfdaf8-6951-424e-b4de-1cc2581757c8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:44.324454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3faf4-c9be-41ff-97eb-b5831c927270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:44.325038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3faf4-c9be-41ff-97eb-b5831c927270 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:44.325322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3faf4-c9be-41ff-97eb-b5831c927270 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:44.325601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3faf4-c9be-41ff-97eb-b5831c927270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:44.326459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3faf4-c9be-41ff-97eb-b5831c927270 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=0921a4780de74b4c94a8a816cea03bdd, user.id=a944bad8a1f94524a4a553beaca4a440) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:44.326778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3faf4-c9be-41ff-97eb-b5831c927270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:44.328293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3faf4-c9be-41ff-97eb-b5831c927270 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:44.335560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 552/1099] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:44 2022] GET /identity/v3/role_assignments?user.id=a944bad8a1f94524a4a553beaca4a440&scope.project.id=0921a4780de74b4c94a8a816cea03bdd&role.id=29dae918965d40bea71d83ffa2085316 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:44.426176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfdaf8-6951-424e-b4de-1cc2581757c8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:44.453250 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:44.467587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0302e-019f-47e5-83e8-0306396d80e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:44.468286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0302e-019f-47e5-83e8-0306396d80e2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:44.468580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0302e-019f-47e5-83e8-0306396d80e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:44.468865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0302e-019f-47e5-83e8-0306396d80e2 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:44.469733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0302e-019f-47e5-83e8-0306396d80e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:44.470059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0302e-019f-47e5-83e8-0306396d80e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:44.471569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0302e-019f-47e5-83e8-0306396d80e2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:44.493953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 548/1100] 10.222.0.46 () {56 vars in 1133 bytes} [Tue Jun 21 15:45:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:44.497256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3faf4-c9be-41ff-97eb-b5831c927270 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:44.606302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3faf4-c9be-41ff-97eb-b5831c927270 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:44.641947 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5e8a3-28fe-4204-b820-f4971b22929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:44.642599 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5e8a3-28fe-4204-b820-f4971b22929b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:44.642889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5e8a3-28fe-4204-b820-f4971b22929b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:44.643197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5e8a3-28fe-4204-b820-f4971b22929b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:44.646945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:44.718830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5e8a3-28fe-4204-b820-f4971b22929b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:44.720337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5e8a3-28fe-4204-b820-f4971b22929b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:44.824283 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 553/1101] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:45:44.830301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0302e-019f-47e5-83e8-0306396d80e2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:44.940309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0302e-019f-47e5-83e8-0306396d80e2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:44.975638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7407-7e7f-4da2-ace5-4dee5df25d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:44.976445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7407-7e7f-4da2-ace5-4dee5df25d2b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:44.976731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7407-7e7f-4da2-ace5-4dee5df25d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:44.977009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7407-7e7f-4da2-ace5-4dee5df25d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:44.987274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a7407-7e7f-4da2-ace5-4dee5df25d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:44.988733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a7407-7e7f-4da2-ace5-4dee5df25d2b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-0c4a7407-7e7f-4da2-ace5-4dee5df25d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:45:45.008425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:45.009760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:45.010980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:45:45.010980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:45:45.010980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:45:45.010980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:45.010980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 549/1102] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:45:45.016319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5e8a3-28fe-4204-b820-f4971b22929b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:45.058754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:45.131694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5e8a3-28fe-4204-b820-f4971b22929b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:45.167960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d9ac-3f3e-4292-af47-900b637617f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:45.168625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d9ac-3f3e-4292-af47-900b637617f5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:45.168910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d9ac-3f3e-4292-af47-900b637617f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:45.169187 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d9ac-3f3e-4292-af47-900b637617f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:45.169909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24d9ac-3f3e-4292-af47-900b637617f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:45.170215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24d9ac-3f3e-4292-af47-900b637617f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:45.171615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24d9ac-3f3e-4292-af47-900b637617f5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:45.183675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 554/1103] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:45.189359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7407-7e7f-4da2-ace5-4dee5df25d2b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:45.221019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:45.290616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7407-7e7f-4da2-ace5-4dee5df25d2b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:45.333712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31203c40-ca17-4838-96a1-b0f4dd4431c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:45.333712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31203c40-ca17-4838-96a1-b0f4dd4431c8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:45.334055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31203c40-ca17-4838-96a1-b0f4dd4431c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:45.334422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31203c40-ca17-4838-96a1-b0f4dd4431c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:45.344578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31203c40-ca17-4838-96a1-b0f4dd4431c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:45.346065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31203c40-ca17-4838-96a1-b0f4dd4431c8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-31203c40-ca17-4838-96a1-b0f4dd4431c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:45:45.363305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:45:45.364309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:45:45.365940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:45:45.365940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:45:45.365940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:45:45.365940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:45:45.365940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:45:45.365940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:45:45.365940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:45:45.365940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:45:45.365940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 550/1104] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:45:45.372884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d9ac-3f3e-4292-af47-900b637617f5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:45.483064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:45.491405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d9ac-3f3e-4292-af47-900b637617f5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:45.529408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493b58f-d14d-4534-8c0b-8772cba35fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:45.530093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493b58f-d14d-4534-8c0b-8772cba35fbe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:45.530382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493b58f-d14d-4534-8c0b-8772cba35fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:45.530664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493b58f-d14d-4534-8c0b-8772cba35fbe None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:45.531516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493b58f-d14d-4534-8c0b-8772cba35fbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:45.531831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493b58f-d14d-4534-8c0b-8772cba35fbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:45.533320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493b58f-d14d-4534-8c0b-8772cba35fbe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:45.547404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 555/1105] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:45.554006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31203c40-ca17-4838-96a1-b0f4dd4431c8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:45.648012 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:45.657540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31203c40-ca17-4838-96a1-b0f4dd4431c8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:45.697040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0ce38-507d-4931-8d39-3adb6ce30c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:45.697992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0ce38-507d-4931-8d39-3adb6ce30c6f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:45.698413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0ce38-507d-4931-8d39-3adb6ce30c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:45.698828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0ce38-507d-4931-8d39-3adb6ce30c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:45.700182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0ce38-507d-4931-8d39-3adb6ce30c6f None admin] RBAC: Adding query filter params (role.id=72d7841f0705491c9a7d4a2679d94457, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2ab989a935eb4d91a94611cededd3cf6) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:45.700658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0ce38-507d-4931-8d39-3adb6ce30c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:45.702879 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0ce38-507d-4931-8d39-3adb6ce30c6f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:45.712514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 551/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:45 2022] GET /identity/v3/role_assignments?user.id=2ab989a935eb4d91a94611cededd3cf6&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=72d7841f0705491c9a7d4a2679d94457 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:46.510500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be4766-9aed-470e-b21d-9c805c3e206f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:46.511016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be4766-9aed-470e-b21d-9c805c3e206f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:46.511108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be4766-9aed-470e-b21d-9c805c3e206f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:46.512481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 556/1107] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:46.518192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8522-1909-4f71-b5e1-02eb3c4446a5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:46.518624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8522-1909-4f71-b5e1-02eb3c4446a5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:46.518764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8522-1909-4f71-b5e1-02eb3c4446a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:46.536403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-196d8522-1909-4f71-b5e1-02eb3c4446a5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:46.538387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-196d8522-1909-4f71-b5e1-02eb3c4446a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:46.606519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 552/1108] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:46.631133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be4766-9aed-470e-b21d-9c805c3e206f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:46.734258 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be4766-9aed-470e-b21d-9c805c3e206f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:46.769067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409afbb-48d0-4c3f-92be-66e774b57a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:46.769789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409afbb-48d0-4c3f-92be-66e774b57a76 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:46.770077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409afbb-48d0-4c3f-92be-66e774b57a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:46.770360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409afbb-48d0-4c3f-92be-66e774b57a76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:46.771851 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409afbb-48d0-4c3f-92be-66e774b57a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:46.773305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409afbb-48d0-4c3f-92be-66e774b57a76 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:46.775069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 557/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:46.780862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8522-1909-4f71-b5e1-02eb3c4446a5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:46.867466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:46.883095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8522-1909-4f71-b5e1-02eb3c4446a5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:46.918255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fde26-0295-40f0-b8c8-f43473612685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:46.918920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fde26-0295-40f0-b8c8-f43473612685 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:46.919241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fde26-0295-40f0-b8c8-f43473612685 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:46.919519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fde26-0295-40f0-b8c8-f43473612685 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:46.920235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fde26-0295-40f0-b8c8-f43473612685 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:46.921674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fde26-0295-40f0-b8c8-f43473612685 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:46.943361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 553/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:45:46 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:45:49.032350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d86e7-f78c-4c9d-9748-f980a90db5ae None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:49.032868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d86e7-f78c-4c9d-9748-f980a90db5ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:49.032984 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d86e7-f78c-4c9d-9748-f980a90db5ae None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:49.034463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 558/1111] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:49.041151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c4922-7fd9-4f34-ba64-d7aafc34e734 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:49.041550 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c4922-7fd9-4f34-ba64-d7aafc34e734 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:49.041722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c4922-7fd9-4f34-ba64-d7aafc34e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:49.058431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e13c4922-7fd9-4f34-ba64-d7aafc34e734 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:49.059660 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e13c4922-7fd9-4f34-ba64-d7aafc34e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:49.128265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 554/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:49.155106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d86e7-f78c-4c9d-9748-f980a90db5ae None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:49.180418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:49.261698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d86e7-f78c-4c9d-9748-f980a90db5ae None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:49.301294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e309d5-f015-40e6-8f03-00ca98f81f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:49.302728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e309d5-f015-40e6-8f03-00ca98f81f29 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:49.303012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e309d5-f015-40e6-8f03-00ca98f81f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:49.303419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e309d5-f015-40e6-8f03-00ca98f81f29 None admin] PATH_INFO: `/v3/roles/8bd0b3ec424b423da0670486cc02bc49` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:49.305331 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e309d5-f015-40e6-8f03-00ca98f81f29 None admin] RBAC: Authorizing `identity:get_role(role_id=8bd0b3ec424b423da0670486cc02bc49)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:49.306720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e309d5-f015-40e6-8f03-00ca98f81f29 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:49.308161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 559/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:45:49 2022] GET /identity/v3/roles/8bd0b3ec424b423da0670486cc02bc49 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:49.314107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c4922-7fd9-4f34-ba64-d7aafc34e734 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:49.389615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:49.426181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c4922-7fd9-4f34-ba64-d7aafc34e734 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:49.463284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb24a2-209e-4c51-8f31-d664fa73b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:49.464171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb24a2-209e-4c51-8f31-d664fa73b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:49.464459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb24a2-209e-4c51-8f31-d664fa73b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:49.464740 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb24a2-209e-4c51-8f31-d664fa73b8e3 None admin] PATH_INFO: `/v3/users/728669fbd407459bba0270bf9c32ea31` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:49.480779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb24a2-209e-4c51-8f31-d664fa73b8e3 None admin] RBAC: Authorizing `identity:get_user(user_id=728669fbd407459bba0270bf9c32ea31)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:49.482254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb24a2-209e-4c51-8f31-d664fa73b8e3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:49.484056 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 555/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:45:49 2022] GET /identity/v3/users/728669fbd407459bba0270bf9c32ea31 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:49.490316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e309d5-f015-40e6-8f03-00ca98f81f29 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:49.596542 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:49.606990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e309d5-f015-40e6-8f03-00ca98f81f29 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:49.646583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0267664-4218-4ff6-a350-78733658b6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:49.647278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0267664-4218-4ff6-a350-78733658b6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:49.647572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0267664-4218-4ff6-a350-78733658b6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:49.647855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0267664-4218-4ff6-a350-78733658b6e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:49.718614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0267664-4218-4ff6-a350-78733658b6e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:49.720481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0267664-4218-4ff6-a350-78733658b6e9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:49.813518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:49.825547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 560/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:45:49.831689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb24a2-209e-4c51-8f31-d664fa73b8e3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:49.935794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb24a2-209e-4c51-8f31-d664fa73b8e3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:49.967073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:49.973221 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90466232-4259-426f-a334-fb935d53958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:49.974213 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90466232-4259-426f-a334-fb935d53958d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:49.974685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90466232-4259-426f-a334-fb935d53958d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:49.974685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90466232-4259-426f-a334-fb935d53958d None admin] PATH_INFO: `/v3/projects/0921a4780de74b4c94a8a816cea03bdd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:49.975899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90466232-4259-426f-a334-fb935d53958d None admin] RBAC: Authorizing `identity:get_project(project_id=0921a4780de74b4c94a8a816cea03bdd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:49.977335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90466232-4259-426f-a334-fb935d53958d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:49.979044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 556/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:45:49 2022] GET /identity/v3/projects/0921a4780de74b4c94a8a816cea03bdd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:49.985415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0267664-4218-4ff6-a350-78733658b6e9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:50.085586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0267664-4218-4ff6-a350-78733658b6e9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:50.120287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b604b0d-561f-4aa8-b770-cbbe8628410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:50.121022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b604b0d-561f-4aa8-b770-cbbe8628410b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:50.121463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b604b0d-561f-4aa8-b770-cbbe8628410b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:50.121567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b604b0d-561f-4aa8-b770-cbbe8628410b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:50.122521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b604b0d-561f-4aa8-b770-cbbe8628410b None admin] RBAC: Adding query filter params (role.id=8bd0b3ec424b423da0670486cc02bc49, scope.project.id=0921a4780de74b4c94a8a816cea03bdd, user.id=728669fbd407459bba0270bf9c32ea31) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:50.122893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b604b0d-561f-4aa8-b770-cbbe8628410b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:50.124529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b604b0d-561f-4aa8-b770-cbbe8628410b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:50.131486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 561/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:49 2022] GET /identity/v3/role_assignments?user.id=728669fbd407459bba0270bf9c32ea31&scope.project.id=0921a4780de74b4c94a8a816cea03bdd&role.id=8bd0b3ec424b423da0670486cc02bc49 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:52.188945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f73ed-b5d5-4338-af0c-adcd58a438ce None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:52.189454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f73ed-b5d5-4338-af0c-adcd58a438ce None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:52.189454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f73ed-b5d5-4338-af0c-adcd58a438ce None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:52.190793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 557/1118] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:52.196871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de82e6e-a266-4ad6-9fb1-6f9cb52c3da8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:52.197316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de82e6e-a266-4ad6-9fb1-6f9cb52c3da8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:52.197423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de82e6e-a266-4ad6-9fb1-6f9cb52c3da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:52.214804 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1de82e6e-a266-4ad6-9fb1-6f9cb52c3da8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:52.216039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1de82e6e-a266-4ad6-9fb1-6f9cb52c3da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:52.265205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:52.283733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 562/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:52.307107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f73ed-b5d5-4338-af0c-adcd58a438ce None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:52.406842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f73ed-b5d5-4338-af0c-adcd58a438ce None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:52.440783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dda2c-0251-444a-91c0-a8f300f0c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:52.441577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dda2c-0251-444a-91c0-a8f300f0c50c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:52.441865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dda2c-0251-444a-91c0-a8f300f0c50c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:52.442147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dda2c-0251-444a-91c0-a8f300f0c50c None admin] PATH_INFO: `/v3/roles/8bd0b3ec424b423da0670486cc02bc49` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:52.444755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dda2c-0251-444a-91c0-a8f300f0c50c None admin] RBAC: Authorizing `identity:get_role(role_id=8bd0b3ec424b423da0670486cc02bc49)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:52.446126 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dda2c-0251-444a-91c0-a8f300f0c50c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:52.447527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 558/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:45:52 2022] GET /identity/v3/roles/8bd0b3ec424b423da0670486cc02bc49 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:52.453494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de82e6e-a266-4ad6-9fb1-6f9cb52c3da8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:52.551228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de82e6e-a266-4ad6-9fb1-6f9cb52c3da8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:52.591144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32946c9d-4412-4c6b-a5de-4de8cd0447ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:52.592052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32946c9d-4412-4c6b-a5de-4de8cd0447ba None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:52.592340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32946c9d-4412-4c6b-a5de-4de8cd0447ba None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:52.592621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32946c9d-4412-4c6b-a5de-4de8cd0447ba None admin] PATH_INFO: `/v3/users/728669fbd407459bba0270bf9c32ea31` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:52.593827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32946c9d-4412-4c6b-a5de-4de8cd0447ba None admin] RBAC: Authorizing `identity:get_user(user_id=728669fbd407459bba0270bf9c32ea31)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:52.595310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32946c9d-4412-4c6b-a5de-4de8cd0447ba None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:52.596963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 563/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:45:52 2022] GET /identity/v3/users/728669fbd407459bba0270bf9c32ea31 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:52.603107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dda2c-0251-444a-91c0-a8f300f0c50c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:52.671517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:52.706636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dda2c-0251-444a-91c0-a8f300f0c50c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:52.742554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98116d2c-a9f4-484a-b8a0-5f130b4ff407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:52.743530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98116d2c-a9f4-484a-b8a0-5f130b4ff407 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:52.743817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98116d2c-a9f4-484a-b8a0-5f130b4ff407 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:52.744097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98116d2c-a9f4-484a-b8a0-5f130b4ff407 None admin] PATH_INFO: `/v3/projects/0921a4780de74b4c94a8a816cea03bdd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:52.745288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98116d2c-a9f4-484a-b8a0-5f130b4ff407 None admin] RBAC: Authorizing `identity:get_project(project_id=0921a4780de74b4c94a8a816cea03bdd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:52.746730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98116d2c-a9f4-484a-b8a0-5f130b4ff407 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:52.748464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 559/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:45:52 2022] GET /identity/v3/projects/0921a4780de74b4c94a8a816cea03bdd => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:52.754622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32946c9d-4412-4c6b-a5de-4de8cd0447ba None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:52.810595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:52.858060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32946c9d-4412-4c6b-a5de-4de8cd0447ba None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:52.892654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55de95-d339-4529-a763-06290ce65ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:52.893544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55de95-d339-4529-a763-06290ce65ab1 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:52.893832 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55de95-d339-4529-a763-06290ce65ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:52.894116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55de95-d339-4529-a763-06290ce65ab1 None admin] PATH_INFO: `/v3/projects/0921a4780de74b4c94a8a816cea03bdd/users/728669fbd407459bba0270bf9c32ea31/roles/8bd0b3ec424b423da0670486cc02bc49` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:52.896566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55de95-d339-4529-a763-06290ce65ab1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0921a4780de74b4c94a8a816cea03bdd, user_id=728669fbd407459bba0270bf9c32ea31, role_id=8bd0b3ec424b423da0670486cc02bc49)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:52.897999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55de95-d339-4529-a763-06290ce65ab1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:52.911088 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 564/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:45:52 2022] PUT /identity/v3/projects/0921a4780de74b4c94a8a816cea03bdd/users/728669fbd407459bba0270bf9c32ea31/roles/8bd0b3ec424b423da0670486cc02bc49 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:45:54.995958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071519-c8e4-4c2a-9c63-e42b2887e6ca None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:54.996505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071519-c8e4-4c2a-9c63-e42b2887e6ca None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:54.996613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071519-c8e4-4c2a-9c63-e42b2887e6ca None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:54.997901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 560/1124] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:55.003236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bda66-b748-46f7-b8e2-07f6c12433f5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:55.003632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bda66-b748-46f7-b8e2-07f6c12433f5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:55.003805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bda66-b748-46f7-b8e2-07f6c12433f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:55.021930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4a3bda66-b748-46f7-b8e2-07f6c12433f5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:55.023135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4a3bda66-b748-46f7-b8e2-07f6c12433f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:55.091574 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 565/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:55.116710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2071519-c8e4-4c2a-9c63-e42b2887e6ca None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:55.218822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2071519-c8e4-4c2a-9c63-e42b2887e6ca None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:55.253039 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e34742-f35a-46eb-bd5d-2fd6a9f6cc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:55.253890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e34742-f35a-46eb-bd5d-2fd6a9f6cc7b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:55.254181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e34742-f35a-46eb-bd5d-2fd6a9f6cc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:55.254461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e34742-f35a-46eb-bd5d-2fd6a9f6cc7b None admin] PATH_INFO: `/v3/roles/8bd0b3ec424b423da0670486cc02bc49` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:55.256115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e34742-f35a-46eb-bd5d-2fd6a9f6cc7b None admin] RBAC: Authorizing `identity:get_role(role_id=8bd0b3ec424b423da0670486cc02bc49)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:55.257484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e34742-f35a-46eb-bd5d-2fd6a9f6cc7b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:55.258859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 561/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:45:55 2022] GET /identity/v3/roles/8bd0b3ec424b423da0670486cc02bc49 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:55.265172 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bda66-b748-46f7-b8e2-07f6c12433f5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:55.307364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:55.363628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bda66-b748-46f7-b8e2-07f6c12433f5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:55.399541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7082a-b162-4f76-a8cc-31fc414f0de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:55.400413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7082a-b162-4f76-a8cc-31fc414f0de4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:55.400693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7082a-b162-4f76-a8cc-31fc414f0de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:55.400965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7082a-b162-4f76-a8cc-31fc414f0de4 None admin] PATH_INFO: `/v3/users/728669fbd407459bba0270bf9c32ea31` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:55.402148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7082a-b162-4f76-a8cc-31fc414f0de4 None admin] RBAC: Authorizing `identity:get_user(user_id=728669fbd407459bba0270bf9c32ea31)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:55.403614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7082a-b162-4f76-a8cc-31fc414f0de4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:55.405248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 566/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:45:55 2022] GET /identity/v3/users/728669fbd407459bba0270bf9c32ea31 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:55.411068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e34742-f35a-46eb-bd5d-2fd6a9f6cc7b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:55.414771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:55.509227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e34742-f35a-46eb-bd5d-2fd6a9f6cc7b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:55.543270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521299bd-3916-475d-834b-ea1b7530c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:55.543913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521299bd-3916-475d-834b-ea1b7530c632 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:55.544199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521299bd-3916-475d-834b-ea1b7530c632 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:55.544478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521299bd-3916-475d-834b-ea1b7530c632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:55.617336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521299bd-3916-475d-834b-ea1b7530c632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:55.618784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521299bd-3916-475d-834b-ea1b7530c632 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:55.621082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:55.720565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 562/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:45:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:45:55.727154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7082a-b162-4f76-a8cc-31fc414f0de4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:55.827505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7082a-b162-4f76-a8cc-31fc414f0de4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:55.838681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:55.862455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d122f-b95b-4690-8ec6-5b7ed39a12d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:55.863356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d122f-b95b-4690-8ec6-5b7ed39a12d8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:55.863645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d122f-b95b-4690-8ec6-5b7ed39a12d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:55.863924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d122f-b95b-4690-8ec6-5b7ed39a12d8 None admin] PATH_INFO: `/v3/projects/0921a4780de74b4c94a8a816cea03bdd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:55.865386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d122f-b95b-4690-8ec6-5b7ed39a12d8 None admin] RBAC: Authorizing `identity:get_project(project_id=0921a4780de74b4c94a8a816cea03bdd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:55.866826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d122f-b95b-4690-8ec6-5b7ed39a12d8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:55.868575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 567/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:45:55 2022] GET /identity/v3/projects/0921a4780de74b4c94a8a816cea03bdd => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:55.874898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521299bd-3916-475d-834b-ea1b7530c632 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:55.974499 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521299bd-3916-475d-834b-ea1b7530c632 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:55.976033 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:56.009243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df1b1c-e2f7-4f3b-af36-ecf8eaa3b30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:56.009884 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df1b1c-e2f7-4f3b-af36-ecf8eaa3b30f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:56.010167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df1b1c-e2f7-4f3b-af36-ecf8eaa3b30f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:56.010445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df1b1c-e2f7-4f3b-af36-ecf8eaa3b30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:56.011325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df1b1c-e2f7-4f3b-af36-ecf8eaa3b30f None admin] RBAC: Adding query filter params (role.id=8bd0b3ec424b423da0670486cc02bc49, scope.project.id=0921a4780de74b4c94a8a816cea03bdd, user.id=728669fbd407459bba0270bf9c32ea31) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:45:56.011629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df1b1c-e2f7-4f3b-af36-ecf8eaa3b30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:56.013297 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df1b1c-e2f7-4f3b-af36-ecf8eaa3b30f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:56.019337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 563/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:45:55 2022] GET /identity/v3/role_assignments?user.id=728669fbd407459bba0270bf9c32ea31&scope.project.id=0921a4780de74b4c94a8a816cea03bdd&role.id=8bd0b3ec424b423da0670486cc02bc49 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:45:58.110198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb41512-d02b-4b48-b966-d791a22479ca None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:58.110771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb41512-d02b-4b48-b966-d791a22479ca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:58.110771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb41512-d02b-4b48-b966-d791a22479ca None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:58.112716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 568/1131] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:45:58.120358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161e0bd-d60d-408f-9ac3-25b85d7535e6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:58.120858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161e0bd-d60d-408f-9ac3-25b85d7535e6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:58.120965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161e0bd-d60d-408f-9ac3-25b85d7535e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:58.137383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a161e0bd-d60d-408f-9ac3-25b85d7535e6 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:45:58.138819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a161e0bd-d60d-408f-9ac3-25b85d7535e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:45:58.204072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 564/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:45:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:45:58.229642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb41512-d02b-4b48-b966-d791a22479ca None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:58.331094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb41512-d02b-4b48-b966-d791a22479ca None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:58.367771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f91f4f-3838-47e7-81a3-cb9cd33543c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:58.368641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91f4f-3838-47e7-81a3-cb9cd33543c8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:58.368962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91f4f-3838-47e7-81a3-cb9cd33543c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:58.369298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91f4f-3838-47e7-81a3-cb9cd33543c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:58.370605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f91f4f-3838-47e7-81a3-cb9cd33543c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:58.372207 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f91f4f-3838-47e7-81a3-cb9cd33543c8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:58.373932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 569/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:45:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:45:58.379834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161e0bd-d60d-408f-9ac3-25b85d7535e6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:45:58.470991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:45:58.478586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161e0bd-d60d-408f-9ac3-25b85d7535e6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:45:58.512150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d999d-dd84-432e-843d-571a1e54b19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:45:58.512802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d999d-dd84-432e-843d-571a1e54b19b None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:45:58.513090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d999d-dd84-432e-843d-571a1e54b19b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:45:58.513369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d999d-dd84-432e-843d-571a1e54b19b None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:45:58.514339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d999d-dd84-432e-843d-571a1e54b19b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:45:58.515819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d999d-dd84-432e-843d-571a1e54b19b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:45:58.542292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 565/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:45:58 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:46:00.670941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d60ed4-ecf4-4ed8-a328-f6b9143a97cb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:00.671504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d60ed4-ecf4-4ed8-a328-f6b9143a97cb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:00.671504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d60ed4-ecf4-4ed8-a328-f6b9143a97cb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:00.672883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 570/1135] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:00.678649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1571-5735-4e2e-a45e-5c8b3b3d9cf0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:00.679127 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1571-5735-4e2e-a45e-5c8b3b3d9cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:00.679246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1571-5735-4e2e-a45e-5c8b3b3d9cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:00.696367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-da6e1571-5735-4e2e-a45e-5c8b3b3d9cf0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:00.697573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-da6e1571-5735-4e2e-a45e-5c8b3b3d9cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:00.773378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 566/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:00.801363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d60ed4-ecf4-4ed8-a328-f6b9143a97cb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:00.850415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:00.907403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d60ed4-ecf4-4ed8-a328-f6b9143a97cb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:00.941930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248beaf4-d93a-44a7-b37c-c81ad28780ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:00.942774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248beaf4-d93a-44a7-b37c-c81ad28780ac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:00.943063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248beaf4-d93a-44a7-b37c-c81ad28780ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:00.943371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248beaf4-d93a-44a7-b37c-c81ad28780ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:00.944618 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248beaf4-d93a-44a7-b37c-c81ad28780ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:00.946062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248beaf4-d93a-44a7-b37c-c81ad28780ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:00.947733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 571/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:46:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:00.953619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e1571-5735-4e2e-a45e-5c8b3b3d9cf0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:01.031187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:01.055106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e1571-5735-4e2e-a45e-5c8b3b3d9cf0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:01.095969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47522d1-1829-4864-bfc9-cd345ef3b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:01.096966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47522d1-1829-4864-bfc9-cd345ef3b088 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:01.097401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47522d1-1829-4864-bfc9-cd345ef3b088 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:01.097826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47522d1-1829-4864-bfc9-cd345ef3b088 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:01.099480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47522d1-1829-4864-bfc9-cd345ef3b088 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:01.101767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47522d1-1829-4864-bfc9-cd345ef3b088 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:01.125832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 567/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:46:00 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:46:03.291188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e3b7-7cfc-41e5-8d4c-e7fae63b974b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:03.291691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e3b7-7cfc-41e5-8d4c-e7fae63b974b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:03.291691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e3b7-7cfc-41e5-8d4c-e7fae63b974b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:03.293053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 572/1139] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:03.298357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b1ff-d661-4b27-bc8d-a34bca0d7dff None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:03.298798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b1ff-d661-4b27-bc8d-a34bca0d7dff None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:03.298929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b1ff-d661-4b27-bc8d-a34bca0d7dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:03.315692 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bb85b1ff-d661-4b27-bc8d-a34bca0d7dff None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:03.316922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bb85b1ff-d661-4b27-bc8d-a34bca0d7dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:03.384073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 568/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:03.409444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9e3b7-7cfc-41e5-8d4c-e7fae63b974b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:03.509624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9e3b7-7cfc-41e5-8d4c-e7fae63b974b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:03.525070 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:03.546458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06e51-992e-440f-81aa-7f53d725ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:03.547183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06e51-992e-440f-81aa-7f53d725ead1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:03.547474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06e51-992e-440f-81aa-7f53d725ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:03.547747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06e51-992e-440f-81aa-7f53d725ead1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:03.558240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c06e51-992e-440f-81aa-7f53d725ead1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d8c06e51-992e-440f-81aa-7f53d725ead1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:46:03.565997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:46:03.567219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:46:03.568783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 573/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:46:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:46:03.573877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85b1ff-d661-4b27-bc8d-a34bca0d7dff None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:03.637061 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:03.675843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85b1ff-d661-4b27-bc8d-a34bca0d7dff None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:03.715707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb591-305c-4999-b059-5480b39a61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:03.716387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb591-305c-4999-b059-5480b39a61a1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:03.716678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb591-305c-4999-b059-5480b39a61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:03.716962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb591-305c-4999-b059-5480b39a61a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:03.717726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb591-305c-4999-b059-5480b39a61a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:03.718040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb591-305c-4999-b059-5480b39a61a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:03.719459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb591-305c-4999-b059-5480b39a61a1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:03.728663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 569/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:46:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:03.734881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06e51-992e-440f-81aa-7f53d725ead1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:03.841178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06e51-992e-440f-81aa-7f53d725ead1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:03.875269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc959da5-8e7a-46cf-b801-f9cc188f3188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:03.876434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959da5-8e7a-46cf-b801-f9cc188f3188 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:03.876725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959da5-8e7a-46cf-b801-f9cc188f3188 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:03.877007 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959da5-8e7a-46cf-b801-f9cc188f3188 None admin] PATH_INFO: `/v3/users/67d2c7ab551048cdbbd27d1233e085d3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:03.891644 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc959da5-8e7a-46cf-b801-f9cc188f3188 None admin] RBAC: Authorizing `identity:get_user(user_id=67d2c7ab551048cdbbd27d1233e085d3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:03.893094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc959da5-8e7a-46cf-b801-f9cc188f3188 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:03.894804 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 574/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:46:03 2022] GET /identity/v3/users/67d2c7ab551048cdbbd27d1233e085d3 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:03.901904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb591-305c-4999-b059-5480b39a61a1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:04.004032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb591-305c-4999-b059-5480b39a61a1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:04.030443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:04.040594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e41a-0c8d-472b-869a-2c0235a224b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:04.041257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e41a-0c8d-472b-869a-2c0235a224b2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:04.041545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e41a-0c8d-472b-869a-2c0235a224b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:04.041832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e41a-0c8d-472b-869a-2c0235a224b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:04.110281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2e41a-0c8d-472b-869a-2c0235a224b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:04.111723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2e41a-0c8d-472b-869a-2c0235a224b2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:04.209720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 570/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:46:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:04.215574 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc959da5-8e7a-46cf-b801-f9cc188f3188 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:04.247676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:04.319279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc959da5-8e7a-46cf-b801-f9cc188f3188 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:04.353992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5f1b0-2db5-4186-b686-37b0e48923c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:04.354845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f1b0-2db5-4186-b686-37b0e48923c2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:04.355131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f1b0-2db5-4186-b686-37b0e48923c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:04.355440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5f1b0-2db5-4186-b686-37b0e48923c2 None admin] PATH_INFO: `/v3/projects/3c501d52e6234760accc762659b93894` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:04.356615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5f1b0-2db5-4186-b686-37b0e48923c2 None admin] RBAC: Authorizing `identity:get_project(project_id=3c501d52e6234760accc762659b93894)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:04.358045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5f1b0-2db5-4186-b686-37b0e48923c2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:04.359774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 575/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:46:04 2022] GET /identity/v3/projects/3c501d52e6234760accc762659b93894 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:04.365960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e41a-0c8d-472b-869a-2c0235a224b2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:04.392161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:04.465125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e41a-0c8d-472b-869a-2c0235a224b2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:04.498425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb735f-5067-4bd5-8e3c-5cfd16594b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:04.499072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb735f-5067-4bd5-8e3c-5cfd16594b08 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:04.499387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb735f-5067-4bd5-8e3c-5cfd16594b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:04.499668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb735f-5067-4bd5-8e3c-5cfd16594b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:04.500501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb735f-5067-4bd5-8e3c-5cfd16594b08 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=3c501d52e6234760accc762659b93894, user.id=67d2c7ab551048cdbbd27d1233e085d3) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:04.500815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb735f-5067-4bd5-8e3c-5cfd16594b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:04.502242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb735f-5067-4bd5-8e3c-5cfd16594b08 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:04.507753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 571/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:46:04 2022] GET /identity/v3/role_assignments?user.id=67d2c7ab551048cdbbd27d1233e085d3&scope.project.id=3c501d52e6234760accc762659b93894&role.id=29dae918965d40bea71d83ffa2085316 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:06.646533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e07d9-8ad2-4b92-be83-9ca6199b30dd None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:06.647069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e07d9-8ad2-4b92-be83-9ca6199b30dd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:06.647069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e07d9-8ad2-4b92-be83-9ca6199b30dd None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:06.648580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 576/1147] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:06.653740 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec9d7-63e1-4951-b9dc-80e67db124c4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:06.654142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec9d7-63e1-4951-b9dc-80e67db124c4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:06.654299 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec9d7-63e1-4951-b9dc-80e67db124c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:06.670935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d72ec9d7-63e1-4951-b9dc-80e67db124c4 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:06.672167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d72ec9d7-63e1-4951-b9dc-80e67db124c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:06.737678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 572/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:06.761537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e07d9-8ad2-4b92-be83-9ca6199b30dd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:06.865261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:06.871382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e07d9-8ad2-4b92-be83-9ca6199b30dd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:06.916352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e99c8-496c-4ebb-82c0-82db4f160ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:06.917595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e99c8-496c-4ebb-82c0-82db4f160ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:06.917979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e99c8-496c-4ebb-82c0-82db4f160ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:06.918257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e99c8-496c-4ebb-82c0-82db4f160ce3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:06.931642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e99c8-496c-4ebb-82c0-82db4f160ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f57e99c8-496c-4ebb-82c0-82db4f160ce3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:46:06.939377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:46:06.940485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:46:06.941547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 577/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:46:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:46:06.947382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ec9d7-63e1-4951-b9dc-80e67db124c4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:06.968432 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:07.048358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ec9d7-63e1-4951-b9dc-80e67db124c4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:07.084096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99816a-c4a6-41e3-92eb-a2d97fb5fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:07.084765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99816a-c4a6-41e3-92eb-a2d97fb5fff3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:07.085051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99816a-c4a6-41e3-92eb-a2d97fb5fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:07.085330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99816a-c4a6-41e3-92eb-a2d97fb5fff3 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:07.086076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99816a-c4a6-41e3-92eb-a2d97fb5fff3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:07.086386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99816a-c4a6-41e3-92eb-a2d97fb5fff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:07.087786 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99816a-c4a6-41e3-92eb-a2d97fb5fff3 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:07.095736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 573/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:46:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:07.102743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e99c8-496c-4ebb-82c0-82db4f160ce3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:07.203999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e99c8-496c-4ebb-82c0-82db4f160ce3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:07.239870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0d11d-0c28-4d8c-a69d-9a3a9ce7f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:07.240880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0d11d-0c28-4d8c-a69d-9a3a9ce7f650 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:07.241173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0d11d-0c28-4d8c-a69d-9a3a9ce7f650 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:07.241537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0d11d-0c28-4d8c-a69d-9a3a9ce7f650 None admin] PATH_INFO: `/v3/users/67d2c7ab551048cdbbd27d1233e085d3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:07.242942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0d11d-0c28-4d8c-a69d-9a3a9ce7f650 None admin] RBAC: Authorizing `identity:get_user(user_id=67d2c7ab551048cdbbd27d1233e085d3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:07.244416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0d11d-0c28-4d8c-a69d-9a3a9ce7f650 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:07.246074 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 578/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:46:07 2022] GET /identity/v3/users/67d2c7ab551048cdbbd27d1233e085d3 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:07.252092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99816a-c4a6-41e3-92eb-a2d97fb5fff3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:07.333253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:07.352856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99816a-c4a6-41e3-92eb-a2d97fb5fff3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:07.385429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b60eb-2b75-4380-b305-3a815c3841b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:07.386288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b60eb-2b75-4380-b305-3a815c3841b6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:07.386579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b60eb-2b75-4380-b305-3a815c3841b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:07.386860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b60eb-2b75-4380-b305-3a815c3841b6 None admin] PATH_INFO: `/v3/projects/3c501d52e6234760accc762659b93894` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:07.388063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b60eb-2b75-4380-b305-3a815c3841b6 None admin] RBAC: Authorizing `identity:get_project(project_id=3c501d52e6234760accc762659b93894)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:07.389763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b60eb-2b75-4380-b305-3a815c3841b6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:07.391480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 574/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:46:07 2022] GET /identity/v3/projects/3c501d52e6234760accc762659b93894 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:46:07.398090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0d11d-0c28-4d8c-a69d-9a3a9ce7f650 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:07.427727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:07.498940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0d11d-0c28-4d8c-a69d-9a3a9ce7f650 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:07.533645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf807a-aaea-4a4f-94f7-024bb1b38eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:07.534549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf807a-aaea-4a4f-94f7-024bb1b38eb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:07.534839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf807a-aaea-4a4f-94f7-024bb1b38eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:07.535121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf807a-aaea-4a4f-94f7-024bb1b38eb5 None admin] PATH_INFO: `/v3/projects/3c501d52e6234760accc762659b93894/users/67d2c7ab551048cdbbd27d1233e085d3/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:07.538032 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf807a-aaea-4a4f-94f7-024bb1b38eb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c501d52e6234760accc762659b93894, user_id=67d2c7ab551048cdbbd27d1233e085d3, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:07.539512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf807a-aaea-4a4f-94f7-024bb1b38eb5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:07.553369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 579/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:46:07 2022] PUT /identity/v3/projects/3c501d52e6234760accc762659b93894/users/67d2c7ab551048cdbbd27d1233e085d3/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:46:09.578141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9a74c-4f3e-4e9d-bdee-ceb9dd93697a None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:09.578752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9a74c-4f3e-4e9d-bdee-ceb9dd93697a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:09.578752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9a74c-4f3e-4e9d-bdee-ceb9dd93697a None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:09.580108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 575/1154] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:09.585914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fccb1f-0c8b-47ed-b967-9171ec533096 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:09.586361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fccb1f-0c8b-47ed-b967-9171ec533096 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:09.586480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fccb1f-0c8b-47ed-b967-9171ec533096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:09.603944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b7fccb1f-0c8b-47ed-b967-9171ec533096 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:09.605158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b7fccb1f-0c8b-47ed-b967-9171ec533096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:09.681374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 580/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:09.705102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9a74c-4f3e-4e9d-bdee-ceb9dd93697a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:09.814652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9a74c-4f3e-4e9d-bdee-ceb9dd93697a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:09.849300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f47a-97c9-421c-b761-c540d53e59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:09.849862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f47a-97c9-421c-b761-c540d53e59be None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:09.850147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f47a-97c9-421c-b761-c540d53e59be None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:09.850421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f47a-97c9-421c-b761-c540d53e59be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:09.861065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4f47a-97c9-421c-b761-c540d53e59be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-afd4f47a-97c9-421c-b761-c540d53e59be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:46:09.869817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:46:09.870996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:46:09.872108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 576/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:46:09.877316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fccb1f-0c8b-47ed-b967-9171ec533096 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:09.897458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:10.004821 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fccb1f-0c8b-47ed-b967-9171ec533096 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:10.038559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645b46f-0497-4c39-bbca-bf1cdd57aebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:10.039593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645b46f-0497-4c39-bbca-bf1cdd57aebe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:10.040136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645b46f-0497-4c39-bbca-bf1cdd57aebe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:10.040420 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645b46f-0497-4c39-bbca-bf1cdd57aebe None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:10.041158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645b46f-0497-4c39-bbca-bf1cdd57aebe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:10.041466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645b46f-0497-4c39-bbca-bf1cdd57aebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:10.042831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645b46f-0497-4c39-bbca-bf1cdd57aebe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:10.050715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 581/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:46:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:10.056822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f47a-97c9-421c-b761-c540d53e59be None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:10.069617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:10.158446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f47a-97c9-421c-b761-c540d53e59be None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:10.191449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca8c08-95f9-43a0-bde4-b2ff8005b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:10.192844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca8c08-95f9-43a0-bde4-b2ff8005b572 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:10.193132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca8c08-95f9-43a0-bde4-b2ff8005b572 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:10.193412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca8c08-95f9-43a0-bde4-b2ff8005b572 None admin] PATH_INFO: `/v3/users/67d2c7ab551048cdbbd27d1233e085d3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:10.194610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca8c08-95f9-43a0-bde4-b2ff8005b572 None admin] RBAC: Authorizing `identity:get_user(user_id=67d2c7ab551048cdbbd27d1233e085d3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:10.196081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca8c08-95f9-43a0-bde4-b2ff8005b572 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:10.197723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 577/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:46:10 2022] GET /identity/v3/users/67d2c7ab551048cdbbd27d1233e085d3 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:10.203530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645b46f-0497-4c39-bbca-bf1cdd57aebe None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:10.285929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:10.305761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645b46f-0497-4c39-bbca-bf1cdd57aebe None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:10.338974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efdd2d-f087-48ad-83a7-f7180444689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:10.339730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efdd2d-f087-48ad-83a7-f7180444689e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:10.340018 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efdd2d-f087-48ad-83a7-f7180444689e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:10.340302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efdd2d-f087-48ad-83a7-f7180444689e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:10.409347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efdd2d-f087-48ad-83a7-f7180444689e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:10.410857 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efdd2d-f087-48ad-83a7-f7180444689e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:10.489502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:10.509893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 582/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:46:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:10.516022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca8c08-95f9-43a0-bde4-b2ff8005b572 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:10.592578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:10.614771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca8c08-95f9-43a0-bde4-b2ff8005b572 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:10.648081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49a742-032f-464c-9b15-9148d088231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:10.648939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49a742-032f-464c-9b15-9148d088231d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:10.649218 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49a742-032f-464c-9b15-9148d088231d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:10.649497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49a742-032f-464c-9b15-9148d088231d None admin] PATH_INFO: `/v3/projects/3c501d52e6234760accc762659b93894` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:10.650658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49a742-032f-464c-9b15-9148d088231d None admin] RBAC: Authorizing `identity:get_project(project_id=3c501d52e6234760accc762659b93894)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:10.652118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49a742-032f-464c-9b15-9148d088231d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:10.653797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 578/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:46:10 2022] GET /identity/v3/projects/3c501d52e6234760accc762659b93894 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:10.660012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efdd2d-f087-48ad-83a7-f7180444689e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:10.758170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efdd2d-f087-48ad-83a7-f7180444689e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:10.791849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac662c-3797-4fe5-9f53-19205c3357d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:10.792498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac662c-3797-4fe5-9f53-19205c3357d7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:10.792788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac662c-3797-4fe5-9f53-19205c3357d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:10.793070 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac662c-3797-4fe5-9f53-19205c3357d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:10.793906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac662c-3797-4fe5-9f53-19205c3357d7 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=3c501d52e6234760accc762659b93894, user.id=67d2c7ab551048cdbbd27d1233e085d3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:10.794229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac662c-3797-4fe5-9f53-19205c3357d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:10.795699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac662c-3797-4fe5-9f53-19205c3357d7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:10.802132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 583/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:46:10 2022] GET /identity/v3/role_assignments?user.id=67d2c7ab551048cdbbd27d1233e085d3&scope.project.id=3c501d52e6234760accc762659b93894&role.id=29dae918965d40bea71d83ffa2085316 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:12.894733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71086fd0-3ee1-4ab9-ad25-b32772edc72b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:12.895804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71086fd0-3ee1-4ab9-ad25-b32772edc72b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:12.895897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71086fd0-3ee1-4ab9-ad25-b32772edc72b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:12.897315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 579/1162] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:12.902813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beade2e-6f4a-42c2-8e01-8ab0df872be8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:12.903349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beade2e-6f4a-42c2-8e01-8ab0df872be8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:12.903455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beade2e-6f4a-42c2-8e01-8ab0df872be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:12.921104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8beade2e-6f4a-42c2-8e01-8ab0df872be8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:12.922308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8beade2e-6f4a-42c2-8e01-8ab0df872be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:12.972690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:13.000673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 584/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:13.024637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71086fd0-3ee1-4ab9-ad25-b32772edc72b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:13.126375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71086fd0-3ee1-4ab9-ad25-b32772edc72b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:13.161566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce7366-358c-404a-ac46-a9009a87a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:13.162212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce7366-358c-404a-ac46-a9009a87a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:13.162505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce7366-358c-404a-ac46-a9009a87a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:13.162788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce7366-358c-404a-ac46-a9009a87a7d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:13.178818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:13.233380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce7366-358c-404a-ac46-a9009a87a7d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:13.234818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce7366-358c-404a-ac46-a9009a87a7d0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:13.331529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 580/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:46:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:13.337939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beade2e-6f4a-42c2-8e01-8ab0df872be8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:13.434967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beade2e-6f4a-42c2-8e01-8ab0df872be8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:13.468987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d0b6d-9552-4d50-8b9d-099931e05959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:13.469783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d0b6d-9552-4d50-8b9d-099931e05959 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:13.470070 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d0b6d-9552-4d50-8b9d-099931e05959 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:13.470346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d0b6d-9552-4d50-8b9d-099931e05959 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:13.477671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d0b6d-9552-4d50-8b9d-099931e05959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:13.479103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d0b6d-9552-4d50-8b9d-099931e05959 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-377d0b6d-9552-4d50-8b9d-099931e05959 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:46:13.493249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:46:13.494567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:46:13.496005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 585/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jun 21 15:46:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:46:13.500754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce7366-358c-404a-ac46-a9009a87a7d0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:13.548055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:13.604139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce7366-358c-404a-ac46-a9009a87a7d0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:13.637978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c5b33-6694-482c-808a-513ea9152d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:13.638896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c5b33-6694-482c-808a-513ea9152d25 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:13.639205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c5b33-6694-482c-808a-513ea9152d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:13.639491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c5b33-6694-482c-808a-513ea9152d25 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:13.640218 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c5b33-6694-482c-808a-513ea9152d25 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:13.640527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c5b33-6694-482c-808a-513ea9152d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:13.641891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c5b33-6694-482c-808a-513ea9152d25 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:13.649597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 581/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Tue Jun 21 15:46:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:15.657248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6580edd-75e4-4599-b3c7-10227f3415c9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:15.657805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6580edd-75e4-4599-b3c7-10227f3415c9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:15.657805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6580edd-75e4-4599-b3c7-10227f3415c9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:15.659235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 586/1167] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:15.665051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf224cf-89fa-4e60-b7a7-22807807a9b4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:15.665492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf224cf-89fa-4e60-b7a7-22807807a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:15.665630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf224cf-89fa-4e60-b7a7-22807807a9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:15.682210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0cf224cf-89fa-4e60-b7a7-22807807a9b4 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:15.683427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0cf224cf-89fa-4e60-b7a7-22807807a9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:15.750209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 582/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:15.774134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6580edd-75e4-4599-b3c7-10227f3415c9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:15.810331 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:15.879992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6580edd-75e4-4599-b3c7-10227f3415c9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:15.917204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9941a7-0534-4870-8bb5-79f83168c5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:15.917780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9941a7-0534-4870-8bb5-79f83168c5de None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:15.918069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9941a7-0534-4870-8bb5-79f83168c5de None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:15.918348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9941a7-0534-4870-8bb5-79f83168c5de None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:15.919101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9941a7-0534-4870-8bb5-79f83168c5de None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:15.920514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9941a7-0534-4870-8bb5-79f83168c5de None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:15.935339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 587/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Tue Jun 21 15:46:15 2022] POST /identity/v3/domains => generated 267 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:46:18.044728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4456a-4729-47fd-a70d-9f5840689504 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:18.045276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4456a-4729-47fd-a70d-9f5840689504 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:18.045276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4456a-4729-47fd-a70d-9f5840689504 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:18.046648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 583/1170] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:18.051970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24fdb-4843-478a-acc4-047b5808e43b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:18.052372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24fdb-4843-478a-acc4-047b5808e43b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:18.052545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24fdb-4843-478a-acc4-047b5808e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:18.069714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0bf24fdb-4843-478a-acc4-047b5808e43b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:18.070928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0bf24fdb-4843-478a-acc4-047b5808e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:18.140234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 588/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:18.165791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4456a-4729-47fd-a70d-9f5840689504 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:18.209091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:18.266948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4456a-4729-47fd-a70d-9f5840689504 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:18.300356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583240b5-3ebd-461c-b598-7862b515b02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:18.301255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583240b5-3ebd-461c-b598-7862b515b02c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:18.301538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583240b5-3ebd-461c-b598-7862b515b02c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:18.301812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583240b5-3ebd-461c-b598-7862b515b02c None admin] PATH_INFO: `/v3/domains/8a4e336a985447d1bd5e9f99307f7c0a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:18.311951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583240b5-3ebd-461c-b598-7862b515b02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=8a4e336a985447d1bd5e9f99307f7c0a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:18.313386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583240b5-3ebd-461c-b598-7862b515b02c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:18.315015 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 584/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Tue Jun 21 15:46:18 2022] GET /identity/v3/domains/8a4e336a985447d1bd5e9f99307f7c0a => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:18.321545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf24fdb-4843-478a-acc4-047b5808e43b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:18.346124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:18.419436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf24fdb-4843-478a-acc4-047b5808e43b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:18.452560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190d78a-680c-4960-a97f-6d47dfb7aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:18.453217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190d78a-680c-4960-a97f-6d47dfb7aea5 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:18.453503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190d78a-680c-4960-a97f-6d47dfb7aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:18.453782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190d78a-680c-4960-a97f-6d47dfb7aea5 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:18.454497 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190d78a-680c-4960-a97f-6d47dfb7aea5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:18.455959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190d78a-680c-4960-a97f-6d47dfb7aea5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:18.481800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 589/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:46:18 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:46:20.551666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b8ec0-fbe4-41b1-99bc-e411ae2863b2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:20.552256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b8ec0-fbe4-41b1-99bc-e411ae2863b2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:20.552256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b8ec0-fbe4-41b1-99bc-e411ae2863b2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:20.553590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 585/1174] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:20.558945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f48cf3-1906-4940-b1c0-53211f4bc0b0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:20.559417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f48cf3-1906-4940-b1c0-53211f4bc0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:20.559558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f48cf3-1906-4940-b1c0-53211f4bc0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:20.576647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d9f48cf3-1906-4940-b1c0-53211f4bc0b0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:20.577889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d9f48cf3-1906-4940-b1c0-53211f4bc0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:20.647149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 590/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:20.672354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b8ec0-fbe4-41b1-99bc-e411ae2863b2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:20.770774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:20.775020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b8ec0-fbe4-41b1-99bc-e411ae2863b2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:20.809810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c81b55-f9f4-43cf-bc31-6d80b83c5b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:20.810591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81b55-f9f4-43cf-bc31-6d80b83c5b3c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:20.810883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81b55-f9f4-43cf-bc31-6d80b83c5b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:20.811202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81b55-f9f4-43cf-bc31-6d80b83c5b3c None admin] PATH_INFO: `/v3/domains/8a4e336a985447d1bd5e9f99307f7c0a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:20.812540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c81b55-f9f4-43cf-bc31-6d80b83c5b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=8a4e336a985447d1bd5e9f99307f7c0a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:20.813984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c81b55-f9f4-43cf-bc31-6d80b83c5b3c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:20.815655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 586/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Tue Jun 21 15:46:20 2022] GET /identity/v3/domains/8a4e336a985447d1bd5e9f99307f7c0a => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:20.821664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f48cf3-1906-4940-b1c0-53211f4bc0b0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:20.829987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:20.924925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f48cf3-1906-4940-b1c0-53211f4bc0b0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:20.960632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8014d-8588-47e1-8d82-c4ab358a9dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:20.961311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8014d-8588-47e1-8d82-c4ab358a9dc1 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:20.961604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8014d-8588-47e1-8d82-c4ab358a9dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:20.961888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8014d-8588-47e1-8d82-c4ab358a9dc1 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:20.962614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8014d-8588-47e1-8d82-c4ab358a9dc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:20.964080 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8014d-8588-47e1-8d82-c4ab358a9dc1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:20.984259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 591/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:46:20 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:46:23.055875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa682465-2f73-41c1-a21f-54098caace52 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:23.056424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa682465-2f73-41c1-a21f-54098caace52 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:23.056424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa682465-2f73-41c1-a21f-54098caace52 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:23.057826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 587/1178] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:23.062954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f667018-0657-4623-b37a-69f6a0633f75 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:23.063495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f667018-0657-4623-b37a-69f6a0633f75 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:23.063590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f667018-0657-4623-b37a-69f6a0633f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:23.081202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8f667018-0657-4623-b37a-69f6a0633f75 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:23.082925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8f667018-0657-4623-b37a-69f6a0633f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:23.139661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:23.151007 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 592/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:23.174681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa682465-2f73-41c1-a21f-54098caace52 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:23.277398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa682465-2f73-41c1-a21f-54098caace52 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:23.313146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d83b54-b867-4fe5-a772-7817a950daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:23.313946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83b54-b867-4fe5-a772-7817a950daa3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:23.314241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83b54-b867-4fe5-a772-7817a950daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:23.314520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83b54-b867-4fe5-a772-7817a950daa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:23.325178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d83b54-b867-4fe5-a772-7817a950daa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-01d83b54-b867-4fe5-a772-7817a950daa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:46:23.333576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:46:23.334739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:46:23.335751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 588/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:46:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:46:23.340865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f667018-0657-4623-b37a-69f6a0633f75 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:23.438066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f667018-0657-4623-b37a-69f6a0633f75 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:23.472609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037193a-7f97-48cd-991a-a02d86f47dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:23.473271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037193a-7f97-48cd-991a-a02d86f47dac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:23.473559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037193a-7f97-48cd-991a-a02d86f47dac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:23.473842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037193a-7f97-48cd-991a-a02d86f47dac None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:23.474590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037193a-7f97-48cd-991a-a02d86f47dac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:23.474901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037193a-7f97-48cd-991a-a02d86f47dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:23.476302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037193a-7f97-48cd-991a-a02d86f47dac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:23.484285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 593/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:46:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:23.490440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d83b54-b867-4fe5-a772-7817a950daa3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:23.519269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:23.595464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d83b54-b867-4fe5-a772-7817a950daa3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:23.631001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b65e98-09b3-4ec7-9db9-f08487790637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:23.631990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b65e98-09b3-4ec7-9db9-f08487790637 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:23.632336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b65e98-09b3-4ec7-9db9-f08487790637 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:23.632620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b65e98-09b3-4ec7-9db9-f08487790637 None admin] PATH_INFO: `/v3/users/ee66af69438d425ea3779477e3166de5` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:23.646672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b65e98-09b3-4ec7-9db9-f08487790637 None admin] RBAC: Authorizing `identity:get_user(user_id=ee66af69438d425ea3779477e3166de5)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:23.648190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b65e98-09b3-4ec7-9db9-f08487790637 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:23.649855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 589/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:46:23 2022] GET /identity/v3/users/ee66af69438d425ea3779477e3166de5 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:46:23.655713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037193a-7f97-48cd-991a-a02d86f47dac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:23.711463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:23.756368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037193a-7f97-48cd-991a-a02d86f47dac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:23.789843 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526c68a-3899-4584-ba30-41fa44694089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:23.790488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c68a-3899-4584-ba30-41fa44694089 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:23.790777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c68a-3899-4584-ba30-41fa44694089 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:23.791057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c68a-3899-4584-ba30-41fa44694089 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:23.874049 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526c68a-3899-4584-ba30-41fa44694089 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:23.876299 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526c68a-3899-4584-ba30-41fa44694089 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:23.936126 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:23.982703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 594/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:46:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:23.988905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b65e98-09b3-4ec7-9db9-f08487790637 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:24.074964 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:24.090779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b65e98-09b3-4ec7-9db9-f08487790637 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:24.124678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e669c50-f00e-4613-8b50-d257f5c3f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:24.125494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e669c50-f00e-4613-8b50-d257f5c3f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:24.125808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e669c50-f00e-4613-8b50-d257f5c3f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:24.126091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e669c50-f00e-4613-8b50-d257f5c3f3b6 None admin] PATH_INFO: `/v3/projects/4b80d2fba6e24ee193a8768aa7c08401` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:24.127303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e669c50-f00e-4613-8b50-d257f5c3f3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=4b80d2fba6e24ee193a8768aa7c08401)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:24.128864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e669c50-f00e-4613-8b50-d257f5c3f3b6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:24.130675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 590/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:46:23 2022] GET /identity/v3/projects/4b80d2fba6e24ee193a8768aa7c08401 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:24.136990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526c68a-3899-4584-ba30-41fa44694089 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:24.265914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526c68a-3899-4584-ba30-41fa44694089 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:24.308655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef010cb-15b2-4818-a5b0-4428d84a8757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:24.309306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef010cb-15b2-4818-a5b0-4428d84a8757 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:24.309596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef010cb-15b2-4818-a5b0-4428d84a8757 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:24.309877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef010cb-15b2-4818-a5b0-4428d84a8757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:24.310709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef010cb-15b2-4818-a5b0-4428d84a8757 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=4b80d2fba6e24ee193a8768aa7c08401, user.id=ee66af69438d425ea3779477e3166de5) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:24.311025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef010cb-15b2-4818-a5b0-4428d84a8757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:24.312492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef010cb-15b2-4818-a5b0-4428d84a8757 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:24.318680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 595/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:46:24 2022] GET /identity/v3/role_assignments?user.id=ee66af69438d425ea3779477e3166de5&scope.project.id=4b80d2fba6e24ee193a8768aa7c08401&role.id=29dae918965d40bea71d83ffa2085316 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:26.349820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066498d-e59a-42ff-8112-19d7bab9ba2b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:26.350336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066498d-e59a-42ff-8112-19d7bab9ba2b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:26.350336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066498d-e59a-42ff-8112-19d7bab9ba2b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:26.351836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 591/1186] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:26.357296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b178167-9cae-41d2-9d06-4d07da40bdd2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:26.357713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b178167-9cae-41d2-9d06-4d07da40bdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:26.357868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b178167-9cae-41d2-9d06-4d07da40bdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:26.375192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2b178167-9cae-41d2-9d06-4d07da40bdd2 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:26.376415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2b178167-9cae-41d2-9d06-4d07da40bdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:26.390480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:26.445216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 596/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:26.468285 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066498d-e59a-42ff-8112-19d7bab9ba2b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:26.576373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066498d-e59a-42ff-8112-19d7bab9ba2b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:26.611479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83dffb-b619-4b3b-a05a-09db8f2d57d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:26.612689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83dffb-b619-4b3b-a05a-09db8f2d57d8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:26.612985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83dffb-b619-4b3b-a05a-09db8f2d57d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:26.613851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83dffb-b619-4b3b-a05a-09db8f2d57d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:26.626904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83dffb-b619-4b3b-a05a-09db8f2d57d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-9c83dffb-b619-4b3b-a05a-09db8f2d57d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:46:26.635578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:46:26.636748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:46:26.637960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 592/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:46:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:46:26.643301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b178167-9cae-41d2-9d06-4d07da40bdd2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:26.743892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b178167-9cae-41d2-9d06-4d07da40bdd2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:26.778953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67181aae-84d1-4cc5-b291-2f943ba7b87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:26.779670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67181aae-84d1-4cc5-b291-2f943ba7b87d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:26.779961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67181aae-84d1-4cc5-b291-2f943ba7b87d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:26.780245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67181aae-84d1-4cc5-b291-2f943ba7b87d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:26.781013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67181aae-84d1-4cc5-b291-2f943ba7b87d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:26.781328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67181aae-84d1-4cc5-b291-2f943ba7b87d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:26.782722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67181aae-84d1-4cc5-b291-2f943ba7b87d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:26.792236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 597/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:46:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:26.798198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83dffb-b619-4b3b-a05a-09db8f2d57d8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:26.814686 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:26.907644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83dffb-b619-4b3b-a05a-09db8f2d57d8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:26.951048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024ac9-b8a1-495b-b347-d959cdbdc3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:26.952035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024ac9-b8a1-495b-b347-d959cdbdc3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:26.952327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024ac9-b8a1-495b-b347-d959cdbdc3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:26.952611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024ac9-b8a1-495b-b347-d959cdbdc3f0 None admin] PATH_INFO: `/v3/users/ee66af69438d425ea3779477e3166de5` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:26.953818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a024ac9-b8a1-495b-b347-d959cdbdc3f0 None admin] RBAC: Authorizing `identity:get_user(user_id=ee66af69438d425ea3779477e3166de5)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:26.955294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a024ac9-b8a1-495b-b347-d959cdbdc3f0 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:26.957437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 593/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:46:26 2022] GET /identity/v3/users/ee66af69438d425ea3779477e3166de5 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:26.963323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67181aae-84d1-4cc5-b291-2f943ba7b87d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:26.977435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:27.069873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67181aae-84d1-4cc5-b291-2f943ba7b87d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:27.110243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1950622-6019-4e9d-8d07-f2c5b6a5ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:27.111113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1950622-6019-4e9d-8d07-f2c5b6a5ac72 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:27.111437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1950622-6019-4e9d-8d07-f2c5b6a5ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:27.111718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1950622-6019-4e9d-8d07-f2c5b6a5ac72 None admin] PATH_INFO: `/v3/projects/4b80d2fba6e24ee193a8768aa7c08401` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:27.112940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1950622-6019-4e9d-8d07-f2c5b6a5ac72 None admin] RBAC: Authorizing `identity:get_project(project_id=4b80d2fba6e24ee193a8768aa7c08401)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:27.114456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1950622-6019-4e9d-8d07-f2c5b6a5ac72 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:27.116238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 598/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:46:26 2022] GET /identity/v3/projects/4b80d2fba6e24ee193a8768aa7c08401 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:27.122316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024ac9-b8a1-495b-b347-d959cdbdc3f0 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:27.210627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:27.230838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024ac9-b8a1-495b-b347-d959cdbdc3f0 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:27.271902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a957b-bd40-4e3d-ac4c-400a0226b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:27.272795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a957b-bd40-4e3d-ac4c-400a0226b7f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:27.273077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a957b-bd40-4e3d-ac4c-400a0226b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:27.273352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a957b-bd40-4e3d-ac4c-400a0226b7f8 None admin] PATH_INFO: `/v3/projects/4b80d2fba6e24ee193a8768aa7c08401/users/ee66af69438d425ea3779477e3166de5/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:27.275374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a957b-bd40-4e3d-ac4c-400a0226b7f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b80d2fba6e24ee193a8768aa7c08401, user_id=ee66af69438d425ea3779477e3166de5, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:27.276751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a957b-bd40-4e3d-ac4c-400a0226b7f8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:27.290919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 594/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:46:27 2022] PUT /identity/v3/projects/4b80d2fba6e24ee193a8768aa7c08401/users/ee66af69438d425ea3779477e3166de5/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:46:29.335277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bea248-dd98-4d0f-ad0a-6e4f4735ffaf None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:29.335906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bea248-dd98-4d0f-ad0a-6e4f4735ffaf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:29.335906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bea248-dd98-4d0f-ad0a-6e4f4735ffaf None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:29.337158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 599/1193] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:46:29.343004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a155c2-3cd0-481c-a41a-ae3da15970a7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:29.343506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a155c2-3cd0-481c-a41a-ae3da15970a7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:29.343620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a155c2-3cd0-481c-a41a-ae3da15970a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:29.361204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b0a155c2-3cd0-481c-a41a-ae3da15970a7 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:46:29.362410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b0a155c2-3cd0-481c-a41a-ae3da15970a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:46:29.434654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 595/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:46:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:46:29.459874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bea248-dd98-4d0f-ad0a-6e4f4735ffaf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:29.541239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:29.565311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bea248-dd98-4d0f-ad0a-6e4f4735ffaf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:29.600987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b74cf-ea08-476b-8f64-407e2b40b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:29.601699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b74cf-ea08-476b-8f64-407e2b40b143 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:29.601991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b74cf-ea08-476b-8f64-407e2b40b143 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:29.602273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b74cf-ea08-476b-8f64-407e2b40b143 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:29.614059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b74cf-ea08-476b-8f64-407e2b40b143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a99b74cf-ea08-476b-8f64-407e2b40b143 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:46:29.622084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:46:29.623201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:46:29.624081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 600/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:46:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:46:29.629748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a155c2-3cd0-481c-a41a-ae3da15970a7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:29.701831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:29.735402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a155c2-3cd0-481c-a41a-ae3da15970a7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:29.770095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147368f7-7805-4247-a0f5-9c3aefcfec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:29.770759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147368f7-7805-4247-a0f5-9c3aefcfec76 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:29.771047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147368f7-7805-4247-a0f5-9c3aefcfec76 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:29.771356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147368f7-7805-4247-a0f5-9c3aefcfec76 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:29.772113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147368f7-7805-4247-a0f5-9c3aefcfec76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:29.772424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147368f7-7805-4247-a0f5-9c3aefcfec76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:29.773793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147368f7-7805-4247-a0f5-9c3aefcfec76 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:29.782041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 596/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:46:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:29.788758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b74cf-ea08-476b-8f64-407e2b40b143 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:29.891993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b74cf-ea08-476b-8f64-407e2b40b143 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:29.925278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40a11-80ae-4abd-be63-97b2436df90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:29.926904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40a11-80ae-4abd-be63-97b2436df90f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:29.927217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40a11-80ae-4abd-be63-97b2436df90f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:29.927499 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40a11-80ae-4abd-be63-97b2436df90f None admin] PATH_INFO: `/v3/users/ee66af69438d425ea3779477e3166de5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:29.928770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d40a11-80ae-4abd-be63-97b2436df90f None admin] RBAC: Authorizing `identity:get_user(user_id=ee66af69438d425ea3779477e3166de5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:29.930198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d40a11-80ae-4abd-be63-97b2436df90f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:29.932166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 601/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Tue Jun 21 15:46:29 2022] GET /identity/v3/users/ee66af69438d425ea3779477e3166de5 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:29.937978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147368f7-7805-4247-a0f5-9c3aefcfec76 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:30.041822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147368f7-7805-4247-a0f5-9c3aefcfec76 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:30.078996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a882df5-52bc-4da4-a051-9ebcc8db74df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:30.079677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a882df5-52bc-4da4-a051-9ebcc8db74df None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:30.079965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a882df5-52bc-4da4-a051-9ebcc8db74df None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:30.080243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a882df5-52bc-4da4-a051-9ebcc8db74df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:30.083474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:30.152925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a882df5-52bc-4da4-a051-9ebcc8db74df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:30.154302 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a882df5-52bc-4da4-a051-9ebcc8db74df None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:30.257365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 597/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:46:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:46:30.264716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40a11-80ae-4abd-be63-97b2436df90f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:30.275382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:30.372345 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40a11-80ae-4abd-be63-97b2436df90f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:30.408172 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa0ce6-3159-480c-a0a0-46ce5d4cdc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:30.409035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0ce6-3159-480c-a0a0-46ce5d4cdc23 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:30.409321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0ce6-3159-480c-a0a0-46ce5d4cdc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:30.409604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0ce6-3159-480c-a0a0-46ce5d4cdc23 None admin] PATH_INFO: `/v3/projects/4b80d2fba6e24ee193a8768aa7c08401` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:30.411673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa0ce6-3159-480c-a0a0-46ce5d4cdc23 None admin] RBAC: Authorizing `identity:get_project(project_id=4b80d2fba6e24ee193a8768aa7c08401)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:30.413192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa0ce6-3159-480c-a0a0-46ce5d4cdc23 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:30.414973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 602/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Tue Jun 21 15:46:30 2022] GET /identity/v3/projects/4b80d2fba6e24ee193a8768aa7c08401 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:30.421197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a882df5-52bc-4da4-a051-9ebcc8db74df None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:46:30.456580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:30.525021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a882df5-52bc-4da4-a051-9ebcc8db74df None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:46:30.559745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddf185-460d-4a49-8c48-6155555f7484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:46:30.560405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf185-460d-4a49-8c48-6155555f7484 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:46:30.560690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf185-460d-4a49-8c48-6155555f7484 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:46:30.560968 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf185-460d-4a49-8c48-6155555f7484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:46:30.561808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddf185-460d-4a49-8c48-6155555f7484 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=4b80d2fba6e24ee193a8768aa7c08401, user.id=ee66af69438d425ea3779477e3166de5) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:46:30.562131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddf185-460d-4a49-8c48-6155555f7484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:46:30.563591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddf185-460d-4a49-8c48-6155555f7484 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:46:30.569692 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 598/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:46:30 2022] GET /identity/v3/role_assignments?user.id=ee66af69438d425ea3779477e3166de5&scope.project.id=4b80d2fba6e24ee193a8768aa7c08401&role.id=29dae918965d40bea71d83ffa2085316 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:46:40.404119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=63 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:46:40.566892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=51 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:30.033119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fba3-f9d4-4933-be3e-f0e5af43647b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:30.033970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fba3-f9d4-4933-be3e-f0e5af43647b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:30.034232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209fba3-f9d4-4933-be3e-f0e5af43647b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:30.036470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 603/1201] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:47:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:47:30.044680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58351b4-bff4-4589-ae3e-1f41b36f93ca None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:30.045529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58351b4-bff4-4589-ae3e-1f41b36f93ca None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:30.045529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58351b4-bff4-4589-ae3e-1f41b36f93ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:30.078739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c58351b4-bff4-4589-ae3e-1f41b36f93ca None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:47:30.081616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c58351b4-bff4-4589-ae3e-1f41b36f93ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:47:30.195310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 599/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:47:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:47:30.220303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fba3-f9d4-4933-be3e-f0e5af43647b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:30.394611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209fba3-f9d4-4933-be3e-f0e5af43647b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:30.449823 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ae900-2269-4bd2-99d6-d67d7238d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:30.450689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ae900-2269-4bd2-99d6-d67d7238d848 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:30.451122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ae900-2269-4bd2-99d6-d67d7238d848 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:30.451328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ae900-2269-4bd2-99d6-d67d7238d848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:30.464439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ae900-2269-4bd2-99d6-d67d7238d848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:30.465956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ae900-2269-4bd2-99d6-d67d7238d848 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-116ae900-2269-4bd2-99d6-d67d7238d848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:30.490336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:30.492966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:30.494661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:30.494661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:30.494661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:30.494661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:30.494661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 604/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:30.497960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58351b4-bff4-4589-ae3e-1f41b36f93ca None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:30.690376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58351b4-bff4-4589-ae3e-1f41b36f93ca None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:30.739366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:30.747730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5f5e2-5187-481e-8622-b4eaac54138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:30.748515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5f5e2-5187-481e-8622-b4eaac54138d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:30.748861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5f5e2-5187-481e-8622-b4eaac54138d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:30.749210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5f5e2-5187-481e-8622-b4eaac54138d None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:30.750033 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5f5e2-5187-481e-8622-b4eaac54138d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:30.750423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5f5e2-5187-481e-8622-b4eaac54138d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:30.753036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5f5e2-5187-481e-8622-b4eaac54138d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:30.769229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 600/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:30.775616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ae900-2269-4bd2-99d6-d67d7238d848 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:30.883843 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:30.970949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ae900-2269-4bd2-99d6-d67d7238d848 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:31.024394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cc417-5c77-4072-b4aa-2750563d8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:31.025048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc417-5c77-4072-b4aa-2750563d8a21 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:31.025337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc417-5c77-4072-b4aa-2750563d8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:31.025627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc417-5c77-4072-b4aa-2750563d8a21 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:31.026398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cc417-5c77-4072-b4aa-2750563d8a21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:31.027970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cc417-5c77-4072-b4aa-2750563d8a21 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:31.060916 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 605/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Tue Jun 21 15:47:30 2022] POST /identity/v3/users => generated 251 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:47:33.412485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b0fbf-0991-4c22-9a6e-6841529a99a6 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:33.415848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b0fbf-0991-4c22-9a6e-6841529a99a6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:33.415848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b0fbf-0991-4c22-9a6e-6841529a99a6 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:33.415848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 601/1206] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:47:33.423478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef3ed-9726-4677-a8a3-d6d193fd4ddd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:33.424454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef3ed-9726-4677-a8a3-d6d193fd4ddd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:33.424850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef3ed-9726-4677-a8a3-d6d193fd4ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:33.446050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f87ef3ed-9726-4677-a8a3-d6d193fd4ddd None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:47:33.447743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f87ef3ed-9726-4677-a8a3-d6d193fd4ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:47:33.539310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 606/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:47:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:47:33.559132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b0fbf-0991-4c22-9a6e-6841529a99a6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:33.746242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b0fbf-0991-4c22-9a6e-6841529a99a6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:33.808183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f959d7-882e-443d-94cb-c6029da6838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:33.809541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f959d7-882e-443d-94cb-c6029da6838f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:33.810000 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f959d7-882e-443d-94cb-c6029da6838f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:33.810446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f959d7-882e-443d-94cb-c6029da6838f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:33.831102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f959d7-882e-443d-94cb-c6029da6838f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-02f959d7-882e-443d-94cb-c6029da6838f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:47:33.844209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:33.846474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:47:33.847718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:33.855254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 602/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:47:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:47:33.858876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef3ed-9726-4677-a8a3-d6d193fd4ddd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:33.952177 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:34.057448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef3ed-9726-4677-a8a3-d6d193fd4ddd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:34.101433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7ad2d-a969-4e3f-a72b-7b6f7445a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:34.102579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7ad2d-a969-4e3f-a72b-7b6f7445a20a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:34.103092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7ad2d-a969-4e3f-a72b-7b6f7445a20a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:34.103602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7ad2d-a969-4e3f-a72b-7b6f7445a20a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:34.105039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7ad2d-a969-4e3f-a72b-7b6f7445a20a None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:34.105610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7ad2d-a969-4e3f-a72b-7b6f7445a20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:34.108276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7ad2d-a969-4e3f-a72b-7b6f7445a20a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:34.125113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 607/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:47:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:34.133694 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f959d7-882e-443d-94cb-c6029da6838f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:34.229899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:34.324362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f959d7-882e-443d-94cb-c6029da6838f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:34.401259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0923a-75b7-4f2a-84cf-ba30bc047511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:34.402633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0923a-75b7-4f2a-84cf-ba30bc047511 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:34.403169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0923a-75b7-4f2a-84cf-ba30bc047511 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:34.403700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0923a-75b7-4f2a-84cf-ba30bc047511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:34.424421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0923a-75b7-4f2a-84cf-ba30bc047511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:34.427376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0923a-75b7-4f2a-84cf-ba30bc047511 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-edb0923a-75b7-4f2a-84cf-ba30bc047511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:34.466479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:34.467535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:34.468429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:34.468429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:34.468429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:34.468429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:34.473857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 603/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:34.478548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7ad2d-a969-4e3f-a72b-7b6f7445a20a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:34.646282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:34.651140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7ad2d-a969-4e3f-a72b-7b6f7445a20a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:34.710590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de16e2b-ad25-43a9-ad0a-f315bee28b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:34.711342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de16e2b-ad25-43a9-ad0a-f315bee28b92 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:34.711645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de16e2b-ad25-43a9-ad0a-f315bee28b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:34.712224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de16e2b-ad25-43a9-ad0a-f315bee28b92 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:34.712735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de16e2b-ad25-43a9-ad0a-f315bee28b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:34.713300 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de16e2b-ad25-43a9-ad0a-f315bee28b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:34.714553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de16e2b-ad25-43a9-ad0a-f315bee28b92 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:34.729542 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 608/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:34.737113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0923a-75b7-4f2a-84cf-ba30bc047511 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:34.904119 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0923a-75b7-4f2a-84cf-ba30bc047511 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:34.906472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:34.970559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3beda6-e224-434b-bf2e-6b9103288b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:34.971404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3beda6-e224-434b-bf2e-6b9103288b9c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:34.971764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3beda6-e224-434b-bf2e-6b9103288b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:34.972037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3beda6-e224-434b-bf2e-6b9103288b9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:34.982418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3beda6-e224-434b-bf2e-6b9103288b9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:34.984128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3beda6-e224-434b-bf2e-6b9103288b9c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-3e3beda6-e224-434b-bf2e-6b9103288b9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:47:35.014950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:35.016496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:35.017776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 604/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:35.027785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de16e2b-ad25-43a9-ad0a-f315bee28b92 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:35.185848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de16e2b-ad25-43a9-ad0a-f315bee28b92 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:35.239710 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b39ec-7bbd-4bd8-9b52-31b7bd374290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:35.240408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b39ec-7bbd-4bd8-9b52-31b7bd374290 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:35.240789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b39ec-7bbd-4bd8-9b52-31b7bd374290 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:35.241095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b39ec-7bbd-4bd8-9b52-31b7bd374290 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:35.241956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b39ec-7bbd-4bd8-9b52-31b7bd374290 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:35.242268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b39ec-7bbd-4bd8-9b52-31b7bd374290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:35.244000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b39ec-7bbd-4bd8-9b52-31b7bd374290 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:35.268782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 609/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jun 21 15:47:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:47:35.277621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3beda6-e224-434b-bf2e-6b9103288b9c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:35.479191 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3beda6-e224-434b-bf2e-6b9103288b9c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:35.533832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b8a32-2811-4309-87ba-1dff5fe89347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:35.534504 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b8a32-2811-4309-87ba-1dff5fe89347 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:35.534811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b8a32-2811-4309-87ba-1dff5fe89347 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:35.535063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b8a32-2811-4309-87ba-1dff5fe89347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:35.574261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:35.618677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b8a32-2811-4309-87ba-1dff5fe89347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:35.620154 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b8a32-2811-4309-87ba-1dff5fe89347 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:35.758658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 605/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:47:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 15:47:35.766065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b39ec-7bbd-4bd8-9b52-31b7bd374290 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:35.790967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:35.928631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b39ec-7bbd-4bd8-9b52-31b7bd374290 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:35.991610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb943b2-5559-46fa-8647-b31142963a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:35.993051 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb943b2-5559-46fa-8647-b31142963a09 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:35.993575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb943b2-5559-46fa-8647-b31142963a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:35.994298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb943b2-5559-46fa-8647-b31142963a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:36.012599 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb943b2-5559-46fa-8647-b31142963a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:36.014683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb943b2-5559-46fa-8647-b31142963a09 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3bb943b2-5559-46fa-8647-b31142963a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:36.042539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:36.043931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:36.045004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:36.045004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:36.045004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:36.045004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:36.045004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 610/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:36.052402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b8a32-2811-4309-87ba-1dff5fe89347 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:36.154024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:36.230624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b8a32-2811-4309-87ba-1dff5fe89347 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:36.307779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ecbcf-cdb8-41e5-8fed-ff0064f96f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:36.309043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ecbcf-cdb8-41e5-8fed-ff0064f96f12 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:36.309679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ecbcf-cdb8-41e5-8fed-ff0064f96f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:36.310302 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ecbcf-cdb8-41e5-8fed-ff0064f96f12 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:36.311898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ecbcf-cdb8-41e5-8fed-ff0064f96f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:36.312476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ecbcf-cdb8-41e5-8fed-ff0064f96f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:36.315368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ecbcf-cdb8-41e5-8fed-ff0064f96f12 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:36.338952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 606/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:36.345666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb943b2-5559-46fa-8647-b31142963a09 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:36.465890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:36.518375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb943b2-5559-46fa-8647-b31142963a09 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:36.582429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1b580-6a9d-489b-834c-2c6b1fc1c813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:36.583667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1b580-6a9d-489b-834c-2c6b1fc1c813 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:36.584097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1b580-6a9d-489b-834c-2c6b1fc1c813 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:36.584501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1b580-6a9d-489b-834c-2c6b1fc1c813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:36.595930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1b580-6a9d-489b-834c-2c6b1fc1c813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:36.598266 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1b580-6a9d-489b-834c-2c6b1fc1c813 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5db1b580-6a9d-489b-834c-2c6b1fc1c813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:47:36.619964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:36.621095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:36.623042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:47:36.623042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:47:36.623042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:47:36.623042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:47:36.623042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:47:36.623042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:47:36.623042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:47:36.623042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:36.627485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 611/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:47:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:47:36.632153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ecbcf-cdb8-41e5-8fed-ff0064f96f12 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:36.825801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ecbcf-cdb8-41e5-8fed-ff0064f96f12 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:36.873383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:36.901912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af774be-cf72-4914-8694-f84b8268f19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:36.903472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af774be-cf72-4914-8694-f84b8268f19a None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:36.904116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af774be-cf72-4914-8694-f84b8268f19a None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:36.904747 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af774be-cf72-4914-8694-f84b8268f19a None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:36.906496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af774be-cf72-4914-8694-f84b8268f19a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:36.907758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af774be-cf72-4914-8694-f84b8268f19a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:36.910704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af774be-cf72-4914-8694-f84b8268f19a None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:36.935252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 607/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:47:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:36.947253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1b580-6a9d-489b-834c-2c6b1fc1c813 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:37.076292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1b580-6a9d-489b-834c-2c6b1fc1c813 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:37.127897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:37.137980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a07975-ba09-4e03-8a53-3ea0df361e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:37.139374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07975-ba09-4e03-8a53-3ea0df361e4e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:37.139928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07975-ba09-4e03-8a53-3ea0df361e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:37.140576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a07975-ba09-4e03-8a53-3ea0df361e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:37.141964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a07975-ba09-4e03-8a53-3ea0df361e4e None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2d1aeacb83a142db99823f29bd1b7cce) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:37.142600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a07975-ba09-4e03-8a53-3ea0df361e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:37.145242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a07975-ba09-4e03-8a53-3ea0df361e4e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:37.167241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 612/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:47:36 2022] GET /identity/v3/role_assignments?user.id=2d1aeacb83a142db99823f29bd1b7cce&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:47:39.689630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67426b9-aebb-4560-ab90-d1774d415b0b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:39.690478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67426b9-aebb-4560-ab90-d1774d415b0b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:39.690478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67426b9-aebb-4560-ab90-d1774d415b0b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:39.691910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 608/1220] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:47:39.697966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb157c3-4dd8-4518-8d01-3f80c8804505 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:39.698881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb157c3-4dd8-4518-8d01-3f80c8804505 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:39.698881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb157c3-4dd8-4518-8d01-3f80c8804505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:39.717659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-feb157c3-4dd8-4518-8d01-3f80c8804505 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:47:39.718912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-feb157c3-4dd8-4518-8d01-3f80c8804505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:47:39.852670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 613/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:47:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:47:39.878102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67426b9-aebb-4560-ab90-d1774d415b0b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:40.069139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67426b9-aebb-4560-ab90-d1774d415b0b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:40.122058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaede8-ea5f-430c-a6e2-82d97677a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:40.122880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaede8-ea5f-430c-a6e2-82d97677a0ca None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:40.123194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaede8-ea5f-430c-a6e2-82d97677a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:40.123465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaede8-ea5f-430c-a6e2-82d97677a0ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:40.142363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdaede8-ea5f-430c-a6e2-82d97677a0ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-0fdaede8-ea5f-430c-a6e2-82d97677a0ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:47:40.150753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:40.152700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:40.154412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 609/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:47:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:47:40.161655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb157c3-4dd8-4518-8d01-3f80c8804505 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:40.302707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb157c3-4dd8-4518-8d01-3f80c8804505 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:40.342129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:40.362874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116ab20-d3ab-41a4-bbcb-f57d61cec70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:40.364138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116ab20-d3ab-41a4-bbcb-f57d61cec70e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:40.364686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116ab20-d3ab-41a4-bbcb-f57d61cec70e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:40.365182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116ab20-d3ab-41a4-bbcb-f57d61cec70e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:40.366611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116ab20-d3ab-41a4-bbcb-f57d61cec70e None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:40.367268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116ab20-d3ab-41a4-bbcb-f57d61cec70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:40.369888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116ab20-d3ab-41a4-bbcb-f57d61cec70e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:40.385613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 614/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:47:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:40.395623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaede8-ea5f-430c-a6e2-82d97677a0ca None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:40.462292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:40.560211 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaede8-ea5f-430c-a6e2-82d97677a0ca None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:40.635894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4b345-f2b7-4669-a675-e43007d888e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:40.636659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4b345-f2b7-4669-a675-e43007d888e5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:40.636969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4b345-f2b7-4669-a675-e43007d888e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:40.637307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4b345-f2b7-4669-a675-e43007d888e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:40.662618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4b345-f2b7-4669-a675-e43007d888e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:40.666220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4b345-f2b7-4669-a675-e43007d888e5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-03b4b345-f2b7-4669-a675-e43007d888e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:40.691143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:40.693905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:40.696010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:40.696010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:40.696010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:40.696010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:40.696010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 610/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:40.700189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116ab20-d3ab-41a4-bbcb-f57d61cec70e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:40.899636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116ab20-d3ab-41a4-bbcb-f57d61cec70e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:40.958904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a857a1-95f9-43ae-8b2e-d4a40490d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:40.959729 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a857a1-95f9-43ae-8b2e-d4a40490d272 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:40.960093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a857a1-95f9-43ae-8b2e-d4a40490d272 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:40.960448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a857a1-95f9-43ae-8b2e-d4a40490d272 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:40.961288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a857a1-95f9-43ae-8b2e-d4a40490d272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:40.961676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a857a1-95f9-43ae-8b2e-d4a40490d272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:40.963211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a857a1-95f9-43ae-8b2e-d4a40490d272 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:40.978039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 615/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:47:40.986050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4b345-f2b7-4669-a675-e43007d888e5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:41.158872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:41.169614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4b345-f2b7-4669-a675-e43007d888e5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:41.220474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93c7ef-4c21-4b65-8d52-41b1f0e4c314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:41.221549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93c7ef-4c21-4b65-8d52-41b1f0e4c314 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:41.221843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93c7ef-4c21-4b65-8d52-41b1f0e4c314 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:41.222129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93c7ef-4c21-4b65-8d52-41b1f0e4c314 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:41.231486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93c7ef-4c21-4b65-8d52-41b1f0e4c314 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:41.232979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93c7ef-4c21-4b65-8d52-41b1f0e4c314 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-da93c7ef-4c21-4b65-8d52-41b1f0e4c314 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:47:41.252802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:41.255207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:41.257112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 611/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:41.262629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a857a1-95f9-43ae-8b2e-d4a40490d272 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:41.334108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:41.417405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a857a1-95f9-43ae-8b2e-d4a40490d272 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:41.460722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c8723-0e73-4828-bc4c-fe65527b08b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:41.461412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c8723-0e73-4828-bc4c-fe65527b08b0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:41.461743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c8723-0e73-4828-bc4c-fe65527b08b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:41.462188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c8723-0e73-4828-bc4c-fe65527b08b0 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:41.462952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c8723-0e73-4828-bc4c-fe65527b08b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:41.463346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c8723-0e73-4828-bc4c-fe65527b08b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:41.464860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c8723-0e73-4828-bc4c-fe65527b08b0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:41.490169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 616/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jun 21 15:47:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:47:41.496773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93c7ef-4c21-4b65-8d52-41b1f0e4c314 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:41.645847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93c7ef-4c21-4b65-8d52-41b1f0e4c314 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:41.717336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d34d41-d3b2-4fb2-9161-c07581c05c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:41.718537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d34d41-d3b2-4fb2-9161-c07581c05c18 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:41.718961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d34d41-d3b2-4fb2-9161-c07581c05c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:41.719434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d34d41-d3b2-4fb2-9161-c07581c05c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:41.740421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d34d41-d3b2-4fb2-9161-c07581c05c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:41.743301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d34d41-d3b2-4fb2-9161-c07581c05c18 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-29d34d41-d3b2-4fb2-9161-c07581c05c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:41.777861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:41.780060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:41.782109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:41.782109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:41.782109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:41.782109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:41.782109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 612/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:41.787273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c8723-0e73-4828-bc4c-fe65527b08b0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:41.981345 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c8723-0e73-4828-bc4c-fe65527b08b0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:41.986201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:42.049589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f243d-67ba-414d-a775-c4351272a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:42.050838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f243d-67ba-414d-a775-c4351272a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:42.051380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f243d-67ba-414d-a775-c4351272a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:42.051864 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f243d-67ba-414d-a775-c4351272a7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:42.053180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f243d-67ba-414d-a775-c4351272a7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:42.053626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f243d-67ba-414d-a775-c4351272a7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:42.056125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f243d-67ba-414d-a775-c4351272a7f6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:42.080553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 617/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:42.090957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d34d41-d3b2-4fb2-9161-c07581c05c18 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:42.109433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:42.312025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d34d41-d3b2-4fb2-9161-c07581c05c18 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:42.368975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31955da-6e88-4dd8-b3b4-c7ce4e065a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:42.369815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31955da-6e88-4dd8-b3b4-c7ce4e065a6c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:42.370111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31955da-6e88-4dd8-b3b4-c7ce4e065a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:42.370392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31955da-6e88-4dd8-b3b4-c7ce4e065a6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:42.380335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31955da-6e88-4dd8-b3b4-c7ce4e065a6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:42.382199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31955da-6e88-4dd8-b3b4-c7ce4e065a6c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f31955da-6e88-4dd8-b3b4-c7ce4e065a6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:47:42.408111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:42.409612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:42.410753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:47:42.410753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:47:42.410753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:47:42.410753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:47:42.410753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:47:42.410753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:47:42.410753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:47:42.410753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:42.411337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 613/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:47:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:42.420964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f243d-67ba-414d-a775-c4351272a7f6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:42.573147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f243d-67ba-414d-a775-c4351272a7f6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:42.620188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb3dd9-0760-485a-ac77-be62b271e918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:42.620983 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3dd9-0760-485a-ac77-be62b271e918 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:42.621302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3dd9-0760-485a-ac77-be62b271e918 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:42.621708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3dd9-0760-485a-ac77-be62b271e918 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:42.622582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb3dd9-0760-485a-ac77-be62b271e918 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:42.622934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb3dd9-0760-485a-ac77-be62b271e918 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:42.624674 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb3dd9-0760-485a-ac77-be62b271e918 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:42.641169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 618/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:47:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:42.648685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31955da-6e88-4dd8-b3b4-c7ce4e065a6c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:42.742594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:42.789626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31955da-6e88-4dd8-b3b4-c7ce4e065a6c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:42.832810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a626e6d-60d0-4231-b8e9-89b7708e5d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:42.833818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a626e6d-60d0-4231-b8e9-89b7708e5d1b None admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:42.834215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a626e6d-60d0-4231-b8e9-89b7708e5d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:42.834573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a626e6d-60d0-4231-b8e9-89b7708e5d1b None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2d1aeacb83a142db99823f29bd1b7cce/roles/eda252044624460d8f0580e810d06eda` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:42.859706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a626e6d-60d0-4231-b8e9-89b7708e5d1b None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=2d1aeacb83a142db99823f29bd1b7cce, role_id=eda252044624460d8f0580e810d06eda)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:42.864565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a626e6d-60d0-4231-b8e9-89b7708e5d1b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:42.887658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 614/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:47:42 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2d1aeacb83a142db99823f29bd1b7cce/roles/eda252044624460d8f0580e810d06eda => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:47:45.255624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f8afd-b2dd-4452-ab14-80a5bfbfb717 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:45.256432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f8afd-b2dd-4452-ab14-80a5bfbfb717 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:45.256432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f8afd-b2dd-4452-ab14-80a5bfbfb717 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:45.257526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 619/1233] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:47:45.264194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7cb6a-d41a-4d9a-ac62-a4e14d25e0c8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:45.264849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7cb6a-d41a-4d9a-ac62-a4e14d25e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:45.264950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7cb6a-d41a-4d9a-ac62-a4e14d25e0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:45.285753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-06a7cb6a-d41a-4d9a-ac62-a4e14d25e0c8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:47:45.286989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-06a7cb6a-d41a-4d9a-ac62-a4e14d25e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:47:45.373013 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 615/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:47:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:47:45.402785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f8afd-b2dd-4452-ab14-80a5bfbfb717 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:45.443096 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:45.554167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f8afd-b2dd-4452-ab14-80a5bfbfb717 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:45.601677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417dccf-e7ec-4931-8036-b8d8bf3d2b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:45.603061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417dccf-e7ec-4931-8036-b8d8bf3d2b1a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:45.603611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417dccf-e7ec-4931-8036-b8d8bf3d2b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:45.604146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417dccf-e7ec-4931-8036-b8d8bf3d2b1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:45.620123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417dccf-e7ec-4931-8036-b8d8bf3d2b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1417dccf-e7ec-4931-8036-b8d8bf3d2b1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:47:45.629501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:45.631688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:45.633740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 620/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Tue Jun 21 15:47:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:45.639096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7cb6a-d41a-4d9a-ac62-a4e14d25e0c8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:45.739095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:45.824711 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7cb6a-d41a-4d9a-ac62-a4e14d25e0c8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:45.879466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f1074-32f6-4069-a719-7d82d149e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:45.880223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f1074-32f6-4069-a719-7d82d149e761 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:45.880461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f1074-32f6-4069-a719-7d82d149e761 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:45.880742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f1074-32f6-4069-a719-7d82d149e761 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:45.881917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f1074-32f6-4069-a719-7d82d149e761 None admin] RBAC: Adding query filter params (name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:45.882234 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f1074-32f6-4069-a719-7d82d149e761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:45.883873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f1074-32f6-4069-a719-7d82d149e761 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:45.896049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 616/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Tue Jun 21 15:47:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:45.902496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417dccf-e7ec-4931-8036-b8d8bf3d2b1a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:46.038353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:46.061782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417dccf-e7ec-4931-8036-b8d8bf3d2b1a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:46.104237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcec66-ab18-43b7-bce9-84843935304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:46.105039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcec66-ab18-43b7-bce9-84843935304a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:46.105355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcec66-ab18-43b7-bce9-84843935304a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:46.105681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcec66-ab18-43b7-bce9-84843935304a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:46.120246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcec66-ab18-43b7-bce9-84843935304a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:46.121826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcec66-ab18-43b7-bce9-84843935304a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-61dcec66-ab18-43b7-bce9-84843935304a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:46.143979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:46.145938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:46.148041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:46.148041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:46.148041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:46.148041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:46.153246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 621/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:46.153611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f1074-32f6-4069-a719-7d82d149e761 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:46.300096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f1074-32f6-4069-a719-7d82d149e761 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:46.321360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:46.367128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0b6eb-16ad-4c7b-a214-4e7b2c343e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:46.368329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0b6eb-16ad-4c7b-a214-4e7b2c343e62 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:46.368926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0b6eb-16ad-4c7b-a214-4e7b2c343e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:46.369462 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0b6eb-16ad-4c7b-a214-4e7b2c343e62 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:46.371072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0b6eb-16ad-4c7b-a214-4e7b2c343e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:46.371661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0b6eb-16ad-4c7b-a214-4e7b2c343e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:46.374634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0b6eb-16ad-4c7b-a214-4e7b2c343e62 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:46.405165 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 617/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:46.411688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcec66-ab18-43b7-bce9-84843935304a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:46.545197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcec66-ab18-43b7-bce9-84843935304a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:46.592871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766438-2308-4caf-9639-d896f50d39de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:46.593732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766438-2308-4caf-9639-d896f50d39de None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:46.594019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766438-2308-4caf-9639-d896f50d39de None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:46.594404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766438-2308-4caf-9639-d896f50d39de None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:46.600484 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:46.613213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38766438-2308-4caf-9639-d896f50d39de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:46.616388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38766438-2308-4caf-9639-d896f50d39de None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-38766438-2308-4caf-9639-d896f50d39de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:47:46.639826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:46.641085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:46.644256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 622/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:46.656641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0b6eb-16ad-4c7b-a214-4e7b2c343e62 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:46.848478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0b6eb-16ad-4c7b-a214-4e7b2c343e62 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:46.905013 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f747-8f04-475b-b377-4e70736ed10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:46.906391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f747-8f04-475b-b377-4e70736ed10c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:46.906861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f747-8f04-475b-b377-4e70736ed10c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:46.907293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1f747-8f04-475b-b377-4e70736ed10c None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:46.908951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1f747-8f04-475b-b377-4e70736ed10c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:46.909460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1f747-8f04-475b-b377-4e70736ed10c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:46.911598 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1f747-8f04-475b-b377-4e70736ed10c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:46.934727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 618/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jun 21 15:47:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:47:46.942888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766438-2308-4caf-9639-d896f50d39de None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:47.132968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766438-2308-4caf-9639-d896f50d39de None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:47.189728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e60e7a-82a4-4469-9da7-d40a9dfd4762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:47.190649 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e60e7a-82a4-4469-9da7-d40a9dfd4762 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:47.191031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e60e7a-82a4-4469-9da7-d40a9dfd4762 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:47.191477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e60e7a-82a4-4469-9da7-d40a9dfd4762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:47.277792 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:47.292729 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e60e7a-82a4-4469-9da7-d40a9dfd4762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:47.295735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e60e7a-82a4-4469-9da7-d40a9dfd4762 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:47.495392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 623/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:47:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:47:47.497221 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f747-8f04-475b-b377-4e70736ed10c None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:47.542318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:47.667610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1f747-8f04-475b-b377-4e70736ed10c None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:47.731505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe44e4d-5e91-4d18-9a6c-b8a198956000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:47.732871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe44e4d-5e91-4d18-9a6c-b8a198956000 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:47.733361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe44e4d-5e91-4d18-9a6c-b8a198956000 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:47.733854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe44e4d-5e91-4d18-9a6c-b8a198956000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:47.753685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe44e4d-5e91-4d18-9a6c-b8a198956000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:47.755128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe44e4d-5e91-4d18-9a6c-b8a198956000 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-7fe44e4d-5e91-4d18-9a6c-b8a198956000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:47.776810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:47.778581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:47.780397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:47.780397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:47.780397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:47.780397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:47.780397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 619/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:47:47.786343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e60e7a-82a4-4469-9da7-d40a9dfd4762 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:47.948005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:47.959095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e60e7a-82a4-4469-9da7-d40a9dfd4762 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:48.039537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658ba03-c8dc-4f60-bb3c-83df63f49b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:48.040616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ba03-c8dc-4f60-bb3c-83df63f49b69 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:48.041138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ba03-c8dc-4f60-bb3c-83df63f49b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:48.041646 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ba03-c8dc-4f60-bb3c-83df63f49b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:48.043072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658ba03-c8dc-4f60-bb3c-83df63f49b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:48.043674 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658ba03-c8dc-4f60-bb3c-83df63f49b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:48.046756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658ba03-c8dc-4f60-bb3c-83df63f49b69 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:48.073092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 624/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:48.084782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe44e4d-5e91-4d18-9a6c-b8a198956000 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:48.226607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:48.272566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe44e4d-5e91-4d18-9a6c-b8a198956000 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:48.324627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0ddca-924d-4f76-b7bd-b7a312adae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:48.325471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0ddca-924d-4f76-b7bd-b7a312adae15 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:48.325766 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0ddca-924d-4f76-b7bd-b7a312adae15 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:48.326047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0ddca-924d-4f76-b7bd-b7a312adae15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:48.337163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0ddca-924d-4f76-b7bd-b7a312adae15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:48.338769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0ddca-924d-4f76-b7bd-b7a312adae15 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-c9c0ddca-924d-4f76-b7bd-b7a312adae15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:47:48.356765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:48.358443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:48.359868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:47:48.359868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:47:48.359868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:47:48.359868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:47:48.359868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:47:48.359868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:47:48.359868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:47:48.359868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:48.359868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 620/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:47:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:48.366863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658ba03-c8dc-4f60-bb3c-83df63f49b69 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:48.521623 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658ba03-c8dc-4f60-bb3c-83df63f49b69 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:48.577616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52da77-245c-4bb7-abc5-6f98a20c2c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:48.578423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52da77-245c-4bb7-abc5-6f98a20c2c4f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:48.578892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52da77-245c-4bb7-abc5-6f98a20c2c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:48.579339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52da77-245c-4bb7-abc5-6f98a20c2c4f None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:48.580473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52da77-245c-4bb7-abc5-6f98a20c2c4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:48.580954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52da77-245c-4bb7-abc5-6f98a20c2c4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:48.582761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52da77-245c-4bb7-abc5-6f98a20c2c4f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:48.603614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 625/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:47:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:48.613040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0ddca-924d-4f76-b7bd-b7a312adae15 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:48.777850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0ddca-924d-4f76-b7bd-b7a312adae15 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:48.844070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885880e-8f9f-4a38-8a8a-d02ede055b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:48.847014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885880e-8f9f-4a38-8a8a-d02ede055b67 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:48.847674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885880e-8f9f-4a38-8a8a-d02ede055b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:48.848233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885880e-8f9f-4a38-8a8a-d02ede055b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:48.850293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885880e-8f9f-4a38-8a8a-d02ede055b67 None admin] RBAC: Adding query filter params (role.id=eda252044624460d8f0580e810d06eda, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2d1aeacb83a142db99823f29bd1b7cce) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:48.850928 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885880e-8f9f-4a38-8a8a-d02ede055b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:48.854027 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885880e-8f9f-4a38-8a8a-d02ede055b67 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:48.867913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 621/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:47:48 2022] GET /identity/v3/role_assignments?user.id=2d1aeacb83a142db99823f29bd1b7cce&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=eda252044624460d8f0580e810d06eda => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:47:51.538652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a2afb-83a8-4179-89f6-0fca9ea1817f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:51.539307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a2afb-83a8-4179-89f6-0fca9ea1817f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:51.539671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a2afb-83a8-4179-89f6-0fca9ea1817f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:51.542349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 626/1247] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:47:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:47:51.550813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cddd4-b985-4788-8d23-8aa6218a46b8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:51.552315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cddd4-b985-4788-8d23-8aa6218a46b8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:51.552760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cddd4-b985-4788-8d23-8aa6218a46b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:51.560732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:51.580933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3d7cddd4-b985-4788-8d23-8aa6218a46b8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:47:51.582391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3d7cddd4-b985-4788-8d23-8aa6218a46b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:47:51.697115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 622/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:47:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:47:51.732259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a2afb-83a8-4179-89f6-0fca9ea1817f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:51.773430 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:51.910928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a2afb-83a8-4179-89f6-0fca9ea1817f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:51.967998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db0fed-57dd-45cc-9241-03f8a0de1ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:51.969575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db0fed-57dd-45cc-9241-03f8a0de1ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:51.970112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db0fed-57dd-45cc-9241-03f8a0de1ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:51.970575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db0fed-57dd-45cc-9241-03f8a0de1ad0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:51.995895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db0fed-57dd-45cc-9241-03f8a0de1ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-57db0fed-57dd-45cc-9241-03f8a0de1ad0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:47:52.013953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:52.015869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:52.017513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 627/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:47:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:52.026024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cddd4-b985-4788-8d23-8aa6218a46b8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:52.176103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cddd4-b985-4788-8d23-8aa6218a46b8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:52.219024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:52.227378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1947766-f162-4d57-9464-4da2b54a22a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:52.228675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1947766-f162-4d57-9464-4da2b54a22a6 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:52.229444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1947766-f162-4d57-9464-4da2b54a22a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:52.229843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1947766-f162-4d57-9464-4da2b54a22a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:52.230840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1947766-f162-4d57-9464-4da2b54a22a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:52.231312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1947766-f162-4d57-9464-4da2b54a22a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:52.233234 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1947766-f162-4d57-9464-4da2b54a22a6 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:52.246962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 623/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:47:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:52.255769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db0fed-57dd-45cc-9241-03f8a0de1ad0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:52.386183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:52.431120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db0fed-57dd-45cc-9241-03f8a0de1ad0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:52.489085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828669-b6a8-40e5-8669-c7f25f42587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:52.490513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828669-b6a8-40e5-8669-c7f25f42587f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:52.491015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828669-b6a8-40e5-8669-c7f25f42587f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:52.491549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828669-b6a8-40e5-8669-c7f25f42587f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:52.513720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1828669-b6a8-40e5-8669-c7f25f42587f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:52.517161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1828669-b6a8-40e5-8669-c7f25f42587f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a1828669-b6a8-40e5-8669-c7f25f42587f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:52.542686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:52.544862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:52.545966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:52.545966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:52.545966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:52.545966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:52.545966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 628/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:47:52.554190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1947766-f162-4d57-9464-4da2b54a22a6 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:52.738172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1947766-f162-4d57-9464-4da2b54a22a6 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:52.798331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd7d99-4c39-4ab3-8e63-939f8a2eaef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:52.799251 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd7d99-4c39-4ab3-8e63-939f8a2eaef1 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:52.799743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd7d99-4c39-4ab3-8e63-939f8a2eaef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:52.800235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd7d99-4c39-4ab3-8e63-939f8a2eaef1 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:52.801221 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd7d99-4c39-4ab3-8e63-939f8a2eaef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:52.801676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd7d99-4c39-4ab3-8e63-939f8a2eaef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:52.803627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd7d99-4c39-4ab3-8e63-939f8a2eaef1 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:52.826316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 624/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:52.834281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828669-b6a8-40e5-8669-c7f25f42587f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:53.005444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828669-b6a8-40e5-8669-c7f25f42587f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:53.053982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:53.068388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd434bed-40a4-41e2-967c-e2c2b8302106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:53.069429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd434bed-40a4-41e2-967c-e2c2b8302106 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:53.069877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd434bed-40a4-41e2-967c-e2c2b8302106 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:53.070588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd434bed-40a4-41e2-967c-e2c2b8302106 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:53.082251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd434bed-40a4-41e2-967c-e2c2b8302106 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:53.084023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd434bed-40a4-41e2-967c-e2c2b8302106 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-dd434bed-40a4-41e2-967c-e2c2b8302106 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:47:53.104636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:53.106818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:53.109431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:53.109431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:53.109431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:47:53.109431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:47:53.109431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:47:53.109431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:47:53.109431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:47:53.109431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:47:53.109431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:47:53.109431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:53.112197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 629/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:53.118832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd7d99-4c39-4ab3-8e63-939f8a2eaef1 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:53.216391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:53.305928 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd7d99-4c39-4ab3-8e63-939f8a2eaef1 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:53.398746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb08d-5f08-48b9-8129-77c013cfcde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:53.399974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb08d-5f08-48b9-8129-77c013cfcde4 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:53.400490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb08d-5f08-48b9-8129-77c013cfcde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:53.400974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb08d-5f08-48b9-8129-77c013cfcde4 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:53.402506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bb08d-5f08-48b9-8129-77c013cfcde4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:53.403104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bb08d-5f08-48b9-8129-77c013cfcde4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:53.406342 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bb08d-5f08-48b9-8129-77c013cfcde4 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:53.436759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 625/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jun 21 15:47:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:53.445142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd434bed-40a4-41e2-967c-e2c2b8302106 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:53.624623 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd434bed-40a4-41e2-967c-e2c2b8302106 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:53.694392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb449-98bb-483b-bbb8-f16d9c68224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:53.702638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb449-98bb-483b-bbb8-f16d9c68224c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:53.702638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb449-98bb-483b-bbb8-f16d9c68224c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:53.702638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcb449-98bb-483b-bbb8-f16d9c68224c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:53.791044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:53.813442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcb449-98bb-483b-bbb8-f16d9c68224c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:53.815523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcb449-98bb-483b-bbb8-f16d9c68224c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:53.992628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 630/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:47:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:47:53.994063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb08d-5f08-48b9-8129-77c013cfcde4 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:54.166833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb08d-5f08-48b9-8129-77c013cfcde4 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:54.190215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:54.225434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f973e69-d0bc-4327-ba64-f2850dc75d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:54.226805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f973e69-d0bc-4327-ba64-f2850dc75d8f None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:54.227354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f973e69-d0bc-4327-ba64-f2850dc75d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:54.227844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f973e69-d0bc-4327-ba64-f2850dc75d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:54.244489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f973e69-d0bc-4327-ba64-f2850dc75d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:54.246539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f973e69-d0bc-4327-ba64-f2850dc75d8f None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-2f973e69-d0bc-4327-ba64-f2850dc75d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:54.278108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:54.280052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:54.283294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:54.283294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:54.283294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:54.283294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:54.283294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 626/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:47:54.287569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb449-98bb-483b-bbb8-f16d9c68224c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:54.431265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:54.448989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcb449-98bb-483b-bbb8-f16d9c68224c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:54.492203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1065965-b3c7-411c-89e2-eb25790436a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:54.493162 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1065965-b3c7-411c-89e2-eb25790436a4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:54.493449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1065965-b3c7-411c-89e2-eb25790436a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:54.493750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1065965-b3c7-411c-89e2-eb25790436a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:54.494488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1065965-b3c7-411c-89e2-eb25790436a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:54.494798 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1065965-b3c7-411c-89e2-eb25790436a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:54.496318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1065965-b3c7-411c-89e2-eb25790436a4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:54.510672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 631/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:54.518179 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f973e69-d0bc-4327-ba64-f2850dc75d8f None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:54.697712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f973e69-d0bc-4327-ba64-f2850dc75d8f None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:54.761408 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d6502-be32-4510-95fc-06b0688bd57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:54.762729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d6502-be32-4510-95fc-06b0688bd57e None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:54.763667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d6502-be32-4510-95fc-06b0688bd57e None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:54.764288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d6502-be32-4510-95fc-06b0688bd57e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:54.774397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d6502-be32-4510-95fc-06b0688bd57e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:54.776003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d6502-be32-4510-95fc-06b0688bd57e None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-a55d6502-be32-4510-95fc-06b0688bd57e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:47:54.793933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:54.795802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:54.798193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:47:54.798193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:47:54.798193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:47:54.798193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:47:54.798193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:47:54.798193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:47:54.798193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:47:54.798193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:47:54.798193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 627/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:47:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:54.803755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1065965-b3c7-411c-89e2-eb25790436a4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:54.980453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1065965-b3c7-411c-89e2-eb25790436a4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:55.023037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6542508-6727-498d-a08b-db48ac289fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:55.023681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6542508-6727-498d-a08b-db48ac289fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:55.023968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6542508-6727-498d-a08b-db48ac289fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:55.024254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6542508-6727-498d-a08b-db48ac289fa6 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:55.025080 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6542508-6727-498d-a08b-db48ac289fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:55.025402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6542508-6727-498d-a08b-db48ac289fa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:55.026910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6542508-6727-498d-a08b-db48ac289fa6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:55.042076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 632/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:55.050174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d6502-be32-4510-95fc-06b0688bd57e None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:55.082846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:55.221634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d6502-be32-4510-95fc-06b0688bd57e None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:55.263725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210656d0-5c39-41c8-ba68-55936a5d1831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:55.264417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210656d0-5c39-41c8-ba68-55936a5d1831 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:55.264703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210656d0-5c39-41c8-ba68-55936a5d1831 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:55.264985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210656d0-5c39-41c8-ba68-55936a5d1831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:55.266410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210656d0-5c39-41c8-ba68-55936a5d1831 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2d1aeacb83a142db99823f29bd1b7cce) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:55.266784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210656d0-5c39-41c8-ba68-55936a5d1831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:55.268598 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210656d0-5c39-41c8-ba68-55936a5d1831 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:55.276002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 628/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:47:55 2022] GET /identity/v3/role_assignments?user.id=2d1aeacb83a142db99823f29bd1b7cce&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=29dae918965d40bea71d83ffa2085316 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:57.578655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5187-a35a-481a-a740-49e5bba2ff06 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:57.579648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5187-a35a-481a-a740-49e5bba2ff06 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:57.579648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5187-a35a-481a-a740-49e5bba2ff06 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:57.581170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 633/1261] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:47:57.586950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4960ef-20d2-4ee9-a545-663fe2c91504 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:57.587731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4960ef-20d2-4ee9-a545-663fe2c91504 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:57.587731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4960ef-20d2-4ee9-a545-663fe2c91504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:57.607524 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ab4960ef-20d2-4ee9-a545-663fe2c91504 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:47:57.608840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ab4960ef-20d2-4ee9-a545-663fe2c91504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:47:57.709980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 629/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:47:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:47:57.733636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5187-a35a-481a-a740-49e5bba2ff06 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:57.746624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:57.855006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5187-a35a-481a-a740-49e5bba2ff06 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:57.898163 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cfb27-405b-4f0e-b7f8-ed0bf5444d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:57.899086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cfb27-405b-4f0e-b7f8-ed0bf5444d18 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:57.899495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cfb27-405b-4f0e-b7f8-ed0bf5444d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:57.899855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cfb27-405b-4f0e-b7f8-ed0bf5444d18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:57.913277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cfb27-405b-4f0e-b7f8-ed0bf5444d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-dd4cfb27-405b-4f0e-b7f8-ed0bf5444d18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:47:57.921490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:57.923577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:57.925180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 634/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:47:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:57.933701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4960ef-20d2-4ee9-a545-663fe2c91504 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:57.964198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:58.063896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4960ef-20d2-4ee9-a545-663fe2c91504 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:58.111792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff439a-36e9-4e5e-9ded-b5ed35bb3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:58.112374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff439a-36e9-4e5e-9ded-b5ed35bb3c6b None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:58.112668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff439a-36e9-4e5e-9ded-b5ed35bb3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:58.112950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff439a-36e9-4e5e-9ded-b5ed35bb3c6b None admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:58.113727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff439a-36e9-4e5e-9ded-b5ed35bb3c6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:58.114041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff439a-36e9-4e5e-9ded-b5ed35bb3c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:58.115476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff439a-36e9-4e5e-9ded-b5ed35bb3c6b None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:58.126128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 630/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:47:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:58.132313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cfb27-405b-4f0e-b7f8-ed0bf5444d18 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:58.223193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:58.270922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cfb27-405b-4f0e-b7f8-ed0bf5444d18 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:58.313904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40ab8-f465-41c8-aa4e-cba9d606f692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:58.314709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40ab8-f465-41c8-aa4e-cba9d606f692 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:58.314999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40ab8-f465-41c8-aa4e-cba9d606f692 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:58.315316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40ab8-f465-41c8-aa4e-cba9d606f692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:58.328969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e40ab8-f465-41c8-aa4e-cba9d606f692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:58.330536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e40ab8-f465-41c8-aa4e-cba9d606f692 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f2e40ab8-f465-41c8-aa4e-cba9d606f692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:58.350780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:58.352487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:58.354226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:58.354226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:58.354226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:58.354226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:58.354226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 635/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:58.359599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff439a-36e9-4e5e-9ded-b5ed35bb3c6b None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:58.458536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:58.498360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff439a-36e9-4e5e-9ded-b5ed35bb3c6b None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:58.577928 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cefc38-eb1c-43bf-b84d-fc57eed4feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:58.579128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cefc38-eb1c-43bf-b84d-fc57eed4feca None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:58.579675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cefc38-eb1c-43bf-b84d-fc57eed4feca None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:58.580185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cefc38-eb1c-43bf-b84d-fc57eed4feca None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:58.581638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cefc38-eb1c-43bf-b84d-fc57eed4feca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:58.582020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cefc38-eb1c-43bf-b84d-fc57eed4feca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:58.584509 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cefc38-eb1c-43bf-b84d-fc57eed4feca None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:58.600123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 631/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:58.606443 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40ab8-f465-41c8-aa4e-cba9d606f692 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:58.795240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40ab8-f465-41c8-aa4e-cba9d606f692 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:58.836573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:58.867780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2e99e-3e28-4474-983d-53b6f6f0bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:58.869317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2e99e-3e28-4474-983d-53b6f6f0bb8c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:58.869830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2e99e-3e28-4474-983d-53b6f6f0bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:58.870307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2e99e-3e28-4474-983d-53b6f6f0bb8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:58.881170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2e99e-3e28-4474-983d-53b6f6f0bb8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:58.882702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2e99e-3e28-4474-983d-53b6f6f0bb8c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-58d2e99e-3e28-4474-983d-53b6f6f0bb8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:47:58.900072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:58.901846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:58.903493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 636/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:58.908527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cefc38-eb1c-43bf-b84d-fc57eed4feca None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:59.098754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cefc38-eb1c-43bf-b84d-fc57eed4feca None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:59.153582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a23306-5e08-447f-9f7d-78230ace2d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:59.154265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23306-5e08-447f-9f7d-78230ace2d58 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:59.154550 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23306-5e08-447f-9f7d-78230ace2d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:59.154827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23306-5e08-447f-9f7d-78230ace2d58 None admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:59.155720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a23306-5e08-447f-9f7d-78230ace2d58 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:59.156034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a23306-5e08-447f-9f7d-78230ace2d58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:59.158371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a23306-5e08-447f-9f7d-78230ace2d58 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:59.168634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:59.180657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 632/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jun 21 15:47:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:47:59.189717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2e99e-3e28-4474-983d-53b6f6f0bb8c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:59.307939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2e99e-3e28-4474-983d-53b6f6f0bb8c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:59.349442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b93882-e3f1-413a-9eb3-a0fec30b874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:59.350224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93882-e3f1-413a-9eb3-a0fec30b874b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:59.350554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93882-e3f1-413a-9eb3-a0fec30b874b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:59.350908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93882-e3f1-413a-9eb3-a0fec30b874b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:59.364237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b93882-e3f1-413a-9eb3-a0fec30b874b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:59.365813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b93882-e3f1-413a-9eb3-a0fec30b874b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f2b93882-e3f1-413a-9eb3-a0fec30b874b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:47:59.394556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:59.396002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:59.397063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:47:59.397063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:47:59.397063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:47:59.397063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:59.397063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 637/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:59.406064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a23306-5e08-447f-9f7d-78230ace2d58 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:59.525653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a23306-5e08-447f-9f7d-78230ace2d58 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:59.567831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddda84-8f6d-4b27-8a61-8cde6ddd7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:59.568510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddda84-8f6d-4b27-8a61-8cde6ddd7418 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:59.568797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddda84-8f6d-4b27-8a61-8cde6ddd7418 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:59.569074 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddda84-8f6d-4b27-8a61-8cde6ddd7418 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:59.569814 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddda84-8f6d-4b27-8a61-8cde6ddd7418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:47:59.570121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddda84-8f6d-4b27-8a61-8cde6ddd7418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:59.571535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddda84-8f6d-4b27-8a61-8cde6ddd7418 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:59.586407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 633/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:47:59.592921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b93882-e3f1-413a-9eb3-a0fec30b874b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:59.634849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:59.732475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b93882-e3f1-413a-9eb3-a0fec30b874b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:47:59.789069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad83f2-9565-45ef-afde-a470c5a1dae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:47:59.790413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad83f2-9565-45ef-afde-a470c5a1dae4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:47:59.790906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad83f2-9565-45ef-afde-a470c5a1dae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:47:59.791421 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad83f2-9565-45ef-afde-a470c5a1dae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:47:59.806761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad83f2-9565-45ef-afde-a470c5a1dae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:47:59.809750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad83f2-9565-45ef-afde-a470c5a1dae4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a4ad83f2-9565-45ef-afde-a470c5a1dae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:47:59.841174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:47:59.842306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:47:59.843579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:47:59.843579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:47:59.843579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:47:59.843579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:47:59.843579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:47:59.843579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:47:59.843579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:47:59.843579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:47:59.845085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 638/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:47:59.853382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddda84-8f6d-4b27-8a61-8cde6ddd7418 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:47:59.926671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:47:59.980452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddda84-8f6d-4b27-8a61-8cde6ddd7418 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:00.021006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c60d0-072d-435c-96a4-92200a2be82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:00.021690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c60d0-072d-435c-96a4-92200a2be82c None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:00.021976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c60d0-072d-435c-96a4-92200a2be82c None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:00.022253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c60d0-072d-435c-96a4-92200a2be82c None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:00.023069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c60d0-072d-435c-96a4-92200a2be82c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:00.023415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c60d0-072d-435c-96a4-92200a2be82c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:00.025001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c60d0-072d-435c-96a4-92200a2be82c None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:00.039794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 634/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:48:00.050865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad83f2-9565-45ef-afde-a470c5a1dae4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:00.181772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:00.193521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad83f2-9565-45ef-afde-a470c5a1dae4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:00.235766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ca65d-04b1-402d-b783-e9a16b79e713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:00.236919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ca65d-04b1-402d-b783-e9a16b79e713 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:00.237201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ca65d-04b1-402d-b783-e9a16b79e713 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:00.237481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ca65d-04b1-402d-b783-e9a16b79e713 None admin] PATH_INFO: `/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2d1aeacb83a142db99823f29bd1b7cce/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:00.239701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ca65d-04b1-402d-b783-e9a16b79e713 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bfffe83744bed97a69a07ec777d92, user_id=2d1aeacb83a142db99823f29bd1b7cce, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:00.241165 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ca65d-04b1-402d-b783-e9a16b79e713 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:00.263615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 639/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Tue Jun 21 15:48:00 2022] PUT /identity/v3/projects/ad1bfffe83744bed97a69a07ec777d92/users/2d1aeacb83a142db99823f29bd1b7cce/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:48:02.463439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3f3b4-d83c-4604-8970-1bbb9c7233f3 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:02.464055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3f3b4-d83c-4604-8970-1bbb9c7233f3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:02.464055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3f3b4-d83c-4604-8970-1bbb9c7233f3 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:02.465385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 635/1274] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:48:02.471217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2ce8b-4392-4bbb-818f-9bc4b02b5088 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:02.471862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2ce8b-4392-4bbb-818f-9bc4b02b5088 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:02.471862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2ce8b-4392-4bbb-818f-9bc4b02b5088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:02.490103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-68f2ce8b-4392-4bbb-818f-9bc4b02b5088 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:48:02.491391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-68f2ce8b-4392-4bbb-818f-9bc4b02b5088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:48:02.572388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 640/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:48:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:48:02.597898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3f3b4-d83c-4604-8970-1bbb9c7233f3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:02.765457 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3f3b4-d83c-4604-8970-1bbb9c7233f3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:02.787965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:02.808283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4be59-2579-4c82-81c5-cb5099f187a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:02.809300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4be59-2579-4c82-81c5-cb5099f187a3 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:02.809529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4be59-2579-4c82-81c5-cb5099f187a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:02.809767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4be59-2579-4c82-81c5-cb5099f187a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:02.823392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4be59-2579-4c82-81c5-cb5099f187a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-d0b4be59-2579-4c82-81c5-cb5099f187a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:48:02.832103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:48:02.833812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:02.834741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 636/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Tue Jun 21 15:48:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:48:02.839740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2ce8b-4392-4bbb-818f-9bc4b02b5088 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:02.941261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:02.964148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2ce8b-4392-4bbb-818f-9bc4b02b5088 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:03.002844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddb14f-723a-4800-8d49-7d63917ba83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:03.003579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddb14f-723a-4800-8d49-7d63917ba83a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:03.003860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddb14f-723a-4800-8d49-7d63917ba83a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:03.004138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddb14f-723a-4800-8d49-7d63917ba83a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:03.004905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddb14f-723a-4800-8d49-7d63917ba83a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:03.005215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddb14f-723a-4800-8d49-7d63917ba83a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:03.006625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddb14f-723a-4800-8d49-7d63917ba83a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:03.017528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 641/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Tue Jun 21 15:48:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:48:03.024056 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4be59-2579-4c82-81c5-cb5099f187a3 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:03.154771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4be59-2579-4c82-81c5-cb5099f187a3 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:03.199560 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed898162-635b-491b-b517-447c6a67d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:03.200372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed898162-635b-491b-b517-447c6a67d709 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:03.200654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed898162-635b-491b-b517-447c6a67d709 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:03.200930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed898162-635b-491b-b517-447c6a67d709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:03.214457 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed898162-635b-491b-b517-447c6a67d709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:03.215974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed898162-635b-491b-b517-447c6a67d709 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-ed898162-635b-491b-b517-447c6a67d709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:48:03.237220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:48:03.238873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:48:03.240644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:48:03.240644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:48:03.240644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:48:03.240644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:03.240644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 637/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:48:03.244688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddb14f-723a-4800-8d49-7d63917ba83a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:03.364755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddb14f-723a-4800-8d49-7d63917ba83a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:03.405698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd2088-7229-4629-82e0-c27324bac504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:03.406407 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd2088-7229-4629-82e0-c27324bac504 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:03.406702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd2088-7229-4629-82e0-c27324bac504 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:03.406985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd2088-7229-4629-82e0-c27324bac504 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:03.407901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd2088-7229-4629-82e0-c27324bac504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:03.408300 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd2088-7229-4629-82e0-c27324bac504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:03.409738 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd2088-7229-4629-82e0-c27324bac504 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:03.424901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 642/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:48:03.431726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed898162-635b-491b-b517-447c6a67d709 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:03.469012 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:03.557055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed898162-635b-491b-b517-447c6a67d709 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:03.598369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07fddc-3247-40de-895c-c98c2fd3b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:03.599259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07fddc-3247-40de-895c-c98c2fd3b10d None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:03.599545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07fddc-3247-40de-895c-c98c2fd3b10d None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:03.599820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07fddc-3247-40de-895c-c98c2fd3b10d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:03.609191 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07fddc-3247-40de-895c-c98c2fd3b10d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:03.611094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07fddc-3247-40de-895c-c98c2fd3b10d None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-cf07fddc-3247-40de-895c-c98c2fd3b10d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:48:03.628988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:48:03.631077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:03.632400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 638/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:48:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:48:03.637085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd2088-7229-4629-82e0-c27324bac504 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:03.642805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:03.816724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd2088-7229-4629-82e0-c27324bac504 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:03.859148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f7042-5029-43b9-8272-53fe89dc1590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:03.860675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f7042-5029-43b9-8272-53fe89dc1590 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:03.860960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f7042-5029-43b9-8272-53fe89dc1590 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:03.861236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f7042-5029-43b9-8272-53fe89dc1590 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:03.862114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f7042-5029-43b9-8272-53fe89dc1590 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:03.862425 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f7042-5029-43b9-8272-53fe89dc1590 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:03.863965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f7042-5029-43b9-8272-53fe89dc1590 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:03.885101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 643/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Tue Jun 21 15:48:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:48:03.896298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07fddc-3247-40de-895c-c98c2fd3b10d None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:04.081065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:04.093680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07fddc-3247-40de-895c-c98c2fd3b10d None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:04.135519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f92d59-f8f4-494d-bf93-7940322cf8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:04.136139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92d59-f8f4-494d-bf93-7940322cf8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:04.136469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92d59-f8f4-494d-bf93-7940322cf8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:04.136792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92d59-f8f4-494d-bf93-7940322cf8b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:04.219327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f92d59-f8f4-494d-bf93-7940322cf8b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:04.220859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f92d59-f8f4-494d-bf93-7940322cf8b5 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:04.325453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:04.339356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 639/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Tue Jun 21 15:48:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:48:04.346737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f7042-5029-43b9-8272-53fe89dc1590 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:04.475862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:04.523881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f7042-5029-43b9-8272-53fe89dc1590 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:04.563112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90799263-a44f-4391-a922-aa8aab3ab7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:04.563954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90799263-a44f-4391-a922-aa8aab3ab7de None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:04.564238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90799263-a44f-4391-a922-aa8aab3ab7de None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:04.564520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90799263-a44f-4391-a922-aa8aab3ab7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:04.576251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90799263-a44f-4391-a922-aa8aab3ab7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:04.577731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90799263-a44f-4391-a922-aa8aab3ab7de None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-90799263-a44f-4391-a922-aa8aab3ab7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:48:04.599553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:48:04.604761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:48:04.607115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:48:04.607115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:48:04.607115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:48:04.607115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:48:04.607115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 644/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:48:04.608449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f92d59-f8f4-494d-bf93-7940322cf8b5 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:04.735674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f92d59-f8f4-494d-bf93-7940322cf8b5 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:04.784475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab80ca-18cb-43ec-b3af-d3c8b1a733e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:04.785153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab80ca-18cb-43ec-b3af-d3c8b1a733e8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:04.785445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab80ca-18cb-43ec-b3af-d3c8b1a733e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:04.785729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab80ca-18cb-43ec-b3af-d3c8b1a733e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:04.786479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab80ca-18cb-43ec-b3af-d3c8b1a733e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:04.786793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab80ca-18cb-43ec-b3af-d3c8b1a733e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:04.788243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab80ca-18cb-43ec-b3af-d3c8b1a733e8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:04.801913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 640/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Tue Jun 21 15:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:48:04.808066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90799263-a44f-4391-a922-aa8aab3ab7de None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:04.932597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90799263-a44f-4391-a922-aa8aab3ab7de None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:04.959828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:04.999283 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee32c-0cdf-4ed7-badb-5f587d81babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:05.000874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee32c-0cdf-4ed7-badb-5f587d81babf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:05.001348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee32c-0cdf-4ed7-badb-5f587d81babf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:05.001845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee32c-0cdf-4ed7-badb-5f587d81babf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:05.015973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee32c-0cdf-4ed7-badb-5f587d81babf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:05.018936 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee32c-0cdf-4ed7-badb-5f587d81babf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4eaee32c-0cdf-4ed7-badb-5f587d81babf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:48:05.048526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:48:05.049611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:48:05.050562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:48:05.050562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:48:05.050562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:48:05.050562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:48:05.050562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:48:05.050562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:48:05.050562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:48:05.050562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jun 21 15:48:05.051001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 645/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Tue Jun 21 15:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:48:05.057310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab80ca-18cb-43ec-b3af-d3c8b1a733e8 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:05.119582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:05.183424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab80ca-18cb-43ec-b3af-d3c8b1a733e8 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:05.227945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347aa08-46af-4f3d-822c-9dd078600a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:05.228749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347aa08-46af-4f3d-822c-9dd078600a80 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:05.229125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347aa08-46af-4f3d-822c-9dd078600a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:05.229511 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347aa08-46af-4f3d-822c-9dd078600a80 None admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:05.230414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347aa08-46af-4f3d-822c-9dd078600a80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:05.230817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347aa08-46af-4f3d-822c-9dd078600a80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:05.232443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347aa08-46af-4f3d-822c-9dd078600a80 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:05.248138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 641/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Tue Jun 21 15:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:48:05.255642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee32c-0cdf-4ed7-badb-5f587d81babf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:05.383077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee32c-0cdf-4ed7-badb-5f587d81babf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:05.424415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d14033-80dd-4a4d-92bd-92e9cb24fff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:05.425094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d14033-80dd-4a4d-92bd-92e9cb24fff0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:05.425389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d14033-80dd-4a4d-92bd-92e9cb24fff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:05.425670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d14033-80dd-4a4d-92bd-92e9cb24fff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:05.426537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d14033-80dd-4a4d-92bd-92e9cb24fff0 None admin] RBAC: Adding query filter params (role.id=29dae918965d40bea71d83ffa2085316, scope.project.id=ad1bfffe83744bed97a69a07ec777d92, user.id=2d1aeacb83a142db99823f29bd1b7cce) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:05.426854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d14033-80dd-4a4d-92bd-92e9cb24fff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:05.428464 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d14033-80dd-4a4d-92bd-92e9cb24fff0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:05.440669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 646/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Tue Jun 21 15:48:05 2022] GET /identity/v3/role_assignments?user.id=2d1aeacb83a142db99823f29bd1b7cce&scope.project.id=ad1bfffe83744bed97a69a07ec777d92&role.id=29dae918965d40bea71d83ffa2085316 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:48:07.691654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb83e8f-c91f-40af-aad7-83dec23e34c4 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:07.692244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb83e8f-c91f-40af-aad7-83dec23e34c4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:07.692244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb83e8f-c91f-40af-aad7-83dec23e34c4 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:07.693653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 642/1288] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:48:07.702481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16ec6d-43a8-4f87-b772-59bded2547b9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:07.703615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16ec6d-43a8-4f87-b772-59bded2547b9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:07.703772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16ec6d-43a8-4f87-b772-59bded2547b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:07.723822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-da16ec6d-43a8-4f87-b772-59bded2547b9 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:48:07.725109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da16ec6d-43a8-4f87-b772-59bded2547b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:48:07.769165 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:07.817974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 647/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:48:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:48:07.853944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb83e8f-c91f-40af-aad7-83dec23e34c4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:08.010150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb83e8f-c91f-40af-aad7-83dec23e34c4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:08.025628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:08.066969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead621b5-b318-49eb-9d1d-f3c17300e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:08.068320 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead621b5-b318-49eb-9d1d-f3c17300e438 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:08.068620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead621b5-b318-49eb-9d1d-f3c17300e438 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:08.068905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead621b5-b318-49eb-9d1d-f3c17300e438 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:08.070787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead621b5-b318-49eb-9d1d-f3c17300e438 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:08.072291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead621b5-b318-49eb-9d1d-f3c17300e438 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-ead621b5-b318-49eb-9d1d-f3c17300e438 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:48:08.085927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:48:08.087987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:08.090054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 643/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jun 21 15:48:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:48:08.096862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16ec6d-43a8-4f87-b772-59bded2547b9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:08.272862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16ec6d-43a8-4f87-b772-59bded2547b9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:08.325104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90a27a-c4a1-4abe-ba23-450a7fd098a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:08.325865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90a27a-c4a1-4abe-ba23-450a7fd098a1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:08.326276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90a27a-c4a1-4abe-ba23-450a7fd098a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:08.326646 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90a27a-c4a1-4abe-ba23-450a7fd098a1 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:08.327514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90a27a-c4a1-4abe-ba23-450a7fd098a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:08.327925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90a27a-c4a1-4abe-ba23-450a7fd098a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:08.330200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90a27a-c4a1-4abe-ba23-450a7fd098a1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:08.337585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 648/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Tue Jun 21 15:48:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:48:08.344456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead621b5-b318-49eb-9d1d-f3c17300e438 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:08.495375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead621b5-b318-49eb-9d1d-f3c17300e438 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:08.544051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f284d97-d521-4744-96bb-0006b77873a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:08.544842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f284d97-d521-4744-96bb-0006b77873a2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:08.545350 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f284d97-d521-4744-96bb-0006b77873a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:08.545813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f284d97-d521-4744-96bb-0006b77873a2 None admin] PATH_INFO: `/v3/services` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:08.546993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f284d97-d521-4744-96bb-0006b77873a2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:08.547510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f284d97-d521-4744-96bb-0006b77873a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:08.549098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f284d97-d521-4744-96bb-0006b77873a2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:08.555567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 644/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Tue Jun 21 15:48:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:48:10.832446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f68f-1aab-4da2-b1d5-8bd7c4e30736 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:10.833016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f68f-1aab-4da2-b1d5-8bd7c4e30736 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:10.833160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f68f-1aab-4da2-b1d5-8bd7c4e30736 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:10.834667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 649/1293] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:48:10.840897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec3b5-6624-4add-affb-d9d8f8a0c8bb None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:10.841436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec3b5-6624-4add-affb-d9d8f8a0c8bb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:10.841571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec3b5-6624-4add-affb-d9d8f8a0c8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:10.862202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-822ec3b5-6624-4add-affb-d9d8f8a0c8bb None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:48:10.863532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-822ec3b5-6624-4add-affb-d9d8f8a0c8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:48:10.901787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:10.951939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 645/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:48:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:48:10.996436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f68f-1aab-4da2-b1d5-8bd7c4e30736 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:11.056452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:11.143634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f68f-1aab-4da2-b1d5-8bd7c4e30736 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:11.187900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d96b28-82c1-4647-9ddc-2935d5efaa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:11.188766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d96b28-82c1-4647-9ddc-2935d5efaa76 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:11.189053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d96b28-82c1-4647-9ddc-2935d5efaa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:11.189336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d96b28-82c1-4647-9ddc-2935d5efaa76 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:11.190081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d96b28-82c1-4647-9ddc-2935d5efaa76 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:11.191672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d96b28-82c1-4647-9ddc-2935d5efaa76 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:11.209530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 650/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Tue Jun 21 15:48:10 2022] POST /identity/v3/services => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:48:13.570062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3810-0019-4a17-8fa6-8441d4b17ada None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:13.570650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3810-0019-4a17-8fa6-8441d4b17ada None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:13.570650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3810-0019-4a17-8fa6-8441d4b17ada None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:13.572153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 646/1296] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:48:13.578375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490429-6830-4ca5-9389-4cda81bb71e4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:13.578973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490429-6830-4ca5-9389-4cda81bb71e4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:13.578973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490429-6830-4ca5-9389-4cda81bb71e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:13.599412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-89490429-6830-4ca5-9389-4cda81bb71e4 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:48:13.600644 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-89490429-6830-4ca5-9389-4cda81bb71e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:48:13.688721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 651/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:48:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:48:13.713941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3810-0019-4a17-8fa6-8441d4b17ada None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:13.848000 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3810-0019-4a17-8fa6-8441d4b17ada None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:13.889856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2716bdc-7715-4cb2-a10d-4b7ea3ade6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:13.891952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2716bdc-7715-4cb2-a10d-4b7ea3ade6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:13.892244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2716bdc-7715-4cb2-a10d-4b7ea3ade6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:13.892528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2716bdc-7715-4cb2-a10d-4b7ea3ade6f2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:13.893210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2716bdc-7715-4cb2-a10d-4b7ea3ade6f2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:13.894704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2716bdc-7715-4cb2-a10d-4b7ea3ade6f2 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-f2716bdc-7715-4cb2-a10d-4b7ea3ade6f2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:48:13.908069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:48:13.909364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:13.910216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 647/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jun 21 15:48:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:48:13.917581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89490429-6830-4ca5-9389-4cda81bb71e4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:13.955125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:14.114006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89490429-6830-4ca5-9389-4cda81bb71e4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:14.154914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d21e9-915d-494a-a913-605a7d7464d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:14.155631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d21e9-915d-494a-a913-605a7d7464d0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:14.156450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d21e9-915d-494a-a913-605a7d7464d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:14.157388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d21e9-915d-494a-a913-605a7d7464d0 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:14.158130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d21e9-915d-494a-a913-605a7d7464d0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:14.158488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d21e9-915d-494a-a913-605a7d7464d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:14.159920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d21e9-915d-494a-a913-605a7d7464d0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:14.165927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 652/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Tue Jun 21 15:48:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:48:14.172919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2716bdc-7715-4cb2-a10d-4b7ea3ade6f2 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:14.209932 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:14.292148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2716bdc-7715-4cb2-a10d-4b7ea3ade6f2 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:14.332081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f6b9e-2b42-47f3-934c-6014fe0368c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:14.332841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f6b9e-2b42-47f3-934c-6014fe0368c8 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:14.333137 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f6b9e-2b42-47f3-934c-6014fe0368c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:14.333463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f6b9e-2b42-47f3-934c-6014fe0368c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:14.334284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f6b9e-2b42-47f3-934c-6014fe0368c8 None admin] RBAC: Adding query filter params (interface=public, service_id=aa5582e53fe144f8b72de2898e58ef25, region_id=RegionOne) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:14.334648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f6b9e-2b42-47f3-934c-6014fe0368c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:14.336105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f6b9e-2b42-47f3-934c-6014fe0368c8 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:14.342110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 648/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Tue Jun 21 15:48:14 2022] GET /identity/v3/endpoints?service_id=aa5582e53fe144f8b72de2898e58ef25&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:48:14.348693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d21e9-915d-494a-a913-605a7d7464d0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:14.448260 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:14.471860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d21e9-915d-494a-a913-605a7d7464d0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:14.514349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc9eb4-617f-4473-93fd-172a6b92e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:14.515546 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9eb4-617f-4473-93fd-172a6b92e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:14.515861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9eb4-617f-4473-93fd-172a6b92e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:14.516822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9eb4-617f-4473-93fd-172a6b92e1a3 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:14.517583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc9eb4-617f-4473-93fd-172a6b92e1a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:14.519010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc9eb4-617f-4473-93fd-172a6b92e1a3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:14.527136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 653/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Tue Jun 21 15:48:14 2022] GET /identity/v3/services => generated 2191 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:48:16.747912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892f1a-3a13-4cfc-88d0-eee0732fa1bd None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:16.748932 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892f1a-3a13-4cfc-88d0-eee0732fa1bd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:16.748932 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892f1a-3a13-4cfc-88d0-eee0732fa1bd None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:16.751454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 649/1302] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:48:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:48:16.757553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4d34-8442-494d-9b2c-5c202e27346b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:16.758146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4d34-8442-494d-9b2c-5c202e27346b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:16.758146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4d34-8442-494d-9b2c-5c202e27346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:16.776493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d6ef4d34-8442-494d-9b2c-5c202e27346b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:48:16.777719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d6ef4d34-8442-494d-9b2c-5c202e27346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:48:16.862595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 654/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:48:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:48:16.890506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892f1a-3a13-4cfc-88d0-eee0732fa1bd None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:17.051452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:17.059842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892f1a-3a13-4cfc-88d0-eee0732fa1bd None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:17.100801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09fa37-e48b-4407-bae3-d44718e31f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:17.101619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09fa37-e48b-4407-bae3-d44718e31f33 None admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:17.101908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09fa37-e48b-4407-bae3-d44718e31f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:17.102190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09fa37-e48b-4407-bae3-d44718e31f33 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:17.102865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09fa37-e48b-4407-bae3-d44718e31f33 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:17.104305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09fa37-e48b-4407-bae3-d44718e31f33 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application [None req-4c09fa37-e48b-4407-bae3-d44718e31f33 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:48:17.118414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:48:17.119845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application with Lock( Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: ERROR keystone.server.flask.application Jun 21 15:48:17.120769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 650/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Tue Jun 21 15:48:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:48:17.126821 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef4d34-8442-494d-9b2c-5c202e27346b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:17.241874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:17.275699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef4d34-8442-494d-9b2c-5c202e27346b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:17.322033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3156a-74df-4dbb-87db-5c60807134ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:17.322626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3156a-74df-4dbb-87db-5c60807134ba None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:17.322913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3156a-74df-4dbb-87db-5c60807134ba None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:17.323216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3156a-74df-4dbb-87db-5c60807134ba None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:17.323954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3156a-74df-4dbb-87db-5c60807134ba None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:48:17.324269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3156a-74df-4dbb-87db-5c60807134ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:17.325693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3156a-74df-4dbb-87db-5c60807134ba None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:17.339067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 655/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Tue Jun 21 15:48:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:48:17.346376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09fa37-e48b-4407-bae3-d44718e31f33 None admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:48:17.481520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09fa37-e48b-4407-bae3-d44718e31f33 None admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:48:17.522626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3a442-88ec-4b9f-b7c1-804ecbe2d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:48:17.523498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a442-88ec-4b9f-b7c1-804ecbe2d7d7 None admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:48:17.523671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a442-88ec-4b9f-b7c1-804ecbe2d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:48:17.523889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a442-88ec-4b9f-b7c1-804ecbe2d7d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:48:17.524664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3a442-88ec-4b9f-b7c1-804ecbe2d7d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:48:17.526083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3a442-88ec-4b9f-b7c1-804ecbe2d7d7 None admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:48:17.552288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 651/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Tue Jun 21 15:48:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:48:27.330929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=30 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:48:27.545791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:34.879880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ecf38-fed4-4692-983c-619f0b4950fc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:34.880743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ecf38-fed4-4692-983c-619f0b4950fc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:34.880743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ecf38-fed4-4692-983c-619f0b4950fc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:34.881908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 656/1307] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:49:34.889084 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22771-0d23-4e0f-82e5-6ae621befcd0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:34.889856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22771-0d23-4e0f-82e5-6ae621befcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:34.889856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22771-0d23-4e0f-82e5-6ae621befcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:35.041270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3ca22771-0d23-4e0f-82e5-6ae621befcd0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:49:35.042539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3ca22771-0d23-4e0f-82e5-6ae621befcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:35.308201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 652/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:49:35.374744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc6719-5b75-4fcf-b920-7e813533bab5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:35.375226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc6719-5b75-4fcf-b920-7e813533bab5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:35.375410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc6719-5b75-4fcf-b920-7e813533bab5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:35.377095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 657/1309] 10.222.0.46 () {54 vars in 964 bytes} [Tue Jun 21 15:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:49:35.390875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caafb6-dfc3-4933-b786-ab3de337c22e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:35.391335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caafb6-dfc3-4933-b786-ab3de337c22e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:35.391583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caafb6-dfc3-4933-b786-ab3de337c22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:35.533417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-32caafb6-dfc3-4933-b786-ab3de337c22e None None] MFA Rules not processed for user `2d3018419d0548eda04b3539681f3df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:49:35.534844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-32caafb6-dfc3-4933-b786-ab3de337c22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:35.567044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:35.725085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 653/1310] 10.222.0.46 () {58 vars in 1061 bytes} [Tue Jun 21 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:49:35.735502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc6719-5b75-4fcf-b920-7e813533bab5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:49:35.737511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2ffc6719-5b75-4fcf-b920-7e813533bab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:35.949092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc6719-5b75-4fcf-b920-7e813533bab5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:49:36.071891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4d263-259c-4c5f-9a80-a889f011f3c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:49:36.073191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4d263-259c-4c5f-9a80-a889f011f3c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:36.073854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4d263-259c-4c5f-9a80-a889f011f3c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:36.074608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4d263-259c-4c5f-9a80-a889f011f3c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:36.079304 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a7a4d263-259c-4c5f-9a80-a889f011f3c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:36.198949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:36.331419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4d263-259c-4c5f-9a80-a889f011f3c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:49:36.333618 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4d263-259c-4c5f-9a80-a889f011f3c7 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:49:36.378877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 658/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:49:39.389503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac6faf-0a3f-498b-95ce-10f022438c4f None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:39.390071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac6faf-0a3f-498b-95ce-10f022438c4f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:39.390071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac6faf-0a3f-498b-95ce-10f022438c4f None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:39.391696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 654/1312] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:49:39.401720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bbd0d-549a-4106-8632-818c81ff7e6c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:39.402482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bbd0d-549a-4106-8632-818c81ff7e6c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:39.402482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bbd0d-549a-4106-8632-818c81ff7e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:39.489629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7c1bbd0d-549a-4106-8632-818c81ff7e6c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:49:39.490909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c1bbd0d-549a-4106-8632-818c81ff7e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:39.619797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 659/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:49:39.666114 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac6faf-0a3f-498b-95ce-10f022438c4f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:49:39.667925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-51ac6faf-0a3f-498b-95ce-10f022438c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:39.834518 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac6faf-0a3f-498b-95ce-10f022438c4f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:49:39.927641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:39.939543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c347d74-cc41-4ba9-9abe-847bdbb1efd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:49:39.940270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c347d74-cc41-4ba9-9abe-847bdbb1efd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:39.940792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c347d74-cc41-4ba9-9abe-847bdbb1efd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:39.941300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c347d74-cc41-4ba9-9abe-847bdbb1efd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:39.945052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9c347d74-cc41-4ba9-9abe-847bdbb1efd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:40.170781 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c347d74-cc41-4ba9-9abe-847bdbb1efd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:49:40.172254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c347d74-cc41-4ba9-9abe-847bdbb1efd2 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:49:40.207759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 655/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:49:42.907700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85b27-8bef-45eb-b4b3-a3070edcabb2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:42.908349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85b27-8bef-45eb-b4b3-a3070edcabb2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:42.908349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85b27-8bef-45eb-b4b3-a3070edcabb2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:42.909697 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 660/1315] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:49:42.915912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d980-c634-4162-9fcc-a2f3f06eeafc None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:42.916761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d980-c634-4162-9fcc-a2f3f06eeafc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:42.916761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5d980-c634-4162-9fcc-a2f3f06eeafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:42.995330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-93b5d980-c634-4162-9fcc-a2f3f06eeafc None None] MFA Rules not processed for user `e87267a1a91149ffb8c5db7e4c35a24c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:49:42.997864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-93b5d980-c634-4162-9fcc-a2f3f06eeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:43.064934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:43.159000 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 656/1316] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:49:43.210784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa85b27-8bef-45eb-b4b3-a3070edcabb2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:49:43.212517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dfa85b27-8bef-45eb-b4b3-a3070edcabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:43.227789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:43.413133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa85b27-8bef-45eb-b4b3-a3070edcabb2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:49:43.521126 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cbb6c-c823-4f34-ae13-5148ca781424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:49:43.522184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cbb6c-c823-4f34-ae13-5148ca781424 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:43.522585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cbb6c-c823-4f34-ae13-5148ca781424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:43.522981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cbb6c-c823-4f34-ae13-5148ca781424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:43.525101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e30cbb6c-c823-4f34-ae13-5148ca781424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:43.612413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:43.681676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cbb6c-c823-4f34-ae13-5148ca781424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:49:43.683066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cbb6c-c823-4f34-ae13-5148ca781424 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:49:43.707714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 661/1317] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:49:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:49:46.621556 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ee8b0-d6e5-4b67-9276-3f5d0c45addd None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:46.622159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ee8b0-d6e5-4b67-9276-3f5d0c45addd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:46.622159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ee8b0-d6e5-4b67-9276-3f5d0c45addd None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:46.623804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 657/1318] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:49:46.630140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a58f07-9532-486a-aa94-570931a0b09d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:46.630688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a58f07-9532-486a-aa94-570931a0b09d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:46.630868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a58f07-9532-486a-aa94-570931a0b09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:46.716420 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e7a58f07-9532-486a-aa94-570931a0b09d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:49:46.717899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e7a58f07-9532-486a-aa94-570931a0b09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:46.842531 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 662/1319] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:49:46.884539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ee8b0-d6e5-4b67-9276-3f5d0c45addd None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:49:46.886476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a89ee8b0-d6e5-4b67-9276-3f5d0c45addd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:47.018773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ee8b0-d6e5-4b67-9276-3f5d0c45addd None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:49:47.108821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97e2e7-58f0-4189-a8fe-9980a7dfab55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:49:47.109487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97e2e7-58f0-4189-a8fe-9980a7dfab55 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:47.109775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97e2e7-58f0-4189-a8fe-9980a7dfab55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:47.110051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97e2e7-58f0-4189-a8fe-9980a7dfab55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:47.112006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9c97e2e7-58f0-4189-a8fe-9980a7dfab55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:47.120263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:47.247172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97e2e7-58f0-4189-a8fe-9980a7dfab55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:49:47.248893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97e2e7-58f0-4189-a8fe-9980a7dfab55 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:49:47.269758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 658/1320] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:49:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:49:50.452398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683af41-f6be-4202-8ae1-4c4f35ae38ec None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:50.453020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683af41-f6be-4202-8ae1-4c4f35ae38ec None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:50.453121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683af41-f6be-4202-8ae1-4c4f35ae38ec None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:50.454584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 663/1321] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:49:50.460894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838a71-7d0a-4d1f-a973-c337c2e570f9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:50.461471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838a71-7d0a-4d1f-a973-c337c2e570f9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:50.461574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838a71-7d0a-4d1f-a973-c337c2e570f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:50.550190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e6838a71-7d0a-4d1f-a973-c337c2e570f9 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:49:50.551488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e6838a71-7d0a-4d1f-a973-c337c2e570f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:50.624817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:50.676795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 659/1322] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:49:50.731521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe52d03-d03d-4f0a-9a55-06efc007f762 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:50.732175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe52d03-d03d-4f0a-9a55-06efc007f762 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:50.732634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe52d03-d03d-4f0a-9a55-06efc007f762 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:50.734918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 664/1323] 10.222.0.46 () {54 vars in 964 bytes} [Tue Jun 21 15:49:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:49:50.743977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954bc8-b684-44a4-90ef-5dc914064194 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:50.744500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954bc8-b684-44a4-90ef-5dc914064194 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:50.744955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954bc8-b684-44a4-90ef-5dc914064194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:50.891501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e6954bc8-b684-44a4-90ef-5dc914064194 None None] MFA Rules not processed for user `2d3018419d0548eda04b3539681f3df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:49:50.892809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e6954bc8-b684-44a4-90ef-5dc914064194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:51.022561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 660/1324] 10.222.0.46 () {58 vars in 1061 bytes} [Tue Jun 21 15:49:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:49:51.033109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe52d03-d03d-4f0a-9a55-06efc007f762 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:49:51.034706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-afe52d03-d03d-4f0a-9a55-06efc007f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:51.057625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:51.165226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe52d03-d03d-4f0a-9a55-06efc007f762 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:49:51.313927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183add82-ccdf-41d2-a09c-cfb97e54abdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:49:51.314499 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183add82-ccdf-41d2-a09c-cfb97e54abdc service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:51.314743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183add82-ccdf-41d2-a09c-cfb97e54abdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:51.315052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183add82-ccdf-41d2-a09c-cfb97e54abdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:51.316998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-183add82-ccdf-41d2-a09c-cfb97e54abdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:51.415145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:51.468545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183add82-ccdf-41d2-a09c-cfb97e54abdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:49:51.470283 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183add82-ccdf-41d2-a09c-cfb97e54abdc service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:49:51.492660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 665/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:49:54.294503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188ebc-a3f1-45e6-860e-1578b155f996 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:54.295500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188ebc-a3f1-45e6-860e-1578b155f996 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:54.295500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c188ebc-a3f1-45e6-860e-1578b155f996 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:54.297442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 661/1326] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:49:54.304732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f60c3-d51e-4b14-8271-e20bc267c615 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:54.305306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f60c3-d51e-4b14-8271-e20bc267c615 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:54.305773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f60c3-d51e-4b14-8271-e20bc267c615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:54.447647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4a2f60c3-d51e-4b14-8271-e20bc267c615 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:49:54.450057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4a2f60c3-d51e-4b14-8271-e20bc267c615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:54.575791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 666/1327] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:49:54.613086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c188ebc-a3f1-45e6-860e-1578b155f996 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:49:54.614932 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8c188ebc-a3f1-45e6-860e-1578b155f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:54.696453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:54.751679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c188ebc-a3f1-45e6-860e-1578b155f996 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:49:54.848731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40980d-e6b5-4d5e-91bb-716af860294a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:49:54.850277 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40980d-e6b5-4d5e-91bb-716af860294a service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:54.850979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40980d-e6b5-4d5e-91bb-716af860294a service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:54.851477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40980d-e6b5-4d5e-91bb-716af860294a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:54.854289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ef40980d-e6b5-4d5e-91bb-716af860294a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:55.012364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:55.017716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40980d-e6b5-4d5e-91bb-716af860294a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:49:55.019621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40980d-e6b5-4d5e-91bb-716af860294a service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:49:55.052685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 662/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:49:57.499087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82b4fa-c0e8-4f04-aa4f-6871934727e0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:57.499737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82b4fa-c0e8-4f04-aa4f-6871934727e0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:57.499737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82b4fa-c0e8-4f04-aa4f-6871934727e0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:57.501130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 667/1329] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:49:57.508086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fa0ca-6ff1-48ed-b440-0f17840260d2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:57.509021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fa0ca-6ff1-48ed-b440-0f17840260d2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:57.509021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fa0ca-6ff1-48ed-b440-0f17840260d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:57.592361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fb8fa0ca-6ff1-48ed-b440-0f17840260d2 None None] MFA Rules not processed for user `e87267a1a91149ffb8c5db7e4c35a24c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:49:57.593782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fb8fa0ca-6ff1-48ed-b440-0f17840260d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:57.741833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 663/1330] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:49:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:49:57.784512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82b4fa-c0e8-4f04-aa4f-6871934727e0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:49:57.786097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eb82b4fa-c0e8-4f04-aa4f-6871934727e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:57.826091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:57.916780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82b4fa-c0e8-4f04-aa4f-6871934727e0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:49:58.035868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b701f-756b-4cbe-97cf-6b14a84a0497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:49:58.036977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b701f-756b-4cbe-97cf-6b14a84a0497 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:49:58.037485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b701f-756b-4cbe-97cf-6b14a84a0497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:49:58.037992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b701f-756b-4cbe-97cf-6b14a84a0497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:49:58.041791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f8b701f-756b-4cbe-97cf-6b14a84a0497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:49:58.200703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:49:58.260696 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b701f-756b-4cbe-97cf-6b14a84a0497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:49:58.266714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b701f-756b-4cbe-97cf-6b14a84a0497 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:49:58.304315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 668/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:49:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:00.963674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc84e1-c0f6-4fe7-b6de-a49f02b617f6 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:00.964278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc84e1-c0f6-4fe7-b6de-a49f02b617f6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:00.964278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc84e1-c0f6-4fe7-b6de-a49f02b617f6 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:00.965870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 664/1332] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:50:00.972155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2527-c14c-4db9-a573-f45c9536ee39 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:00.972981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2527-c14c-4db9-a573-f45c9536ee39 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:00.972981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f2527-c14c-4db9-a573-f45c9536ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:01.051477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5e9f2527-c14c-4db9-a573-f45c9536ee39 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:01.052723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5e9f2527-c14c-4db9-a573-f45c9536ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:01.169143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 669/1333] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:01.205899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc84e1-c0f6-4fe7-b6de-a49f02b617f6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:01.207513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3fcc84e1-c0f6-4fe7-b6de-a49f02b617f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:01.290149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:50:01.331851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc84e1-c0f6-4fe7-b6de-a49f02b617f6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:01.419053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25c8ff-fa51-42bc-b676-6d85879b482f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:01.419955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c8ff-fa51-42bc-b676-6d85879b482f service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:01.420431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c8ff-fa51-42bc-b676-6d85879b482f service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:01.420768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25c8ff-fa51-42bc-b676-6d85879b482f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:01.422465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3d25c8ff-fa51-42bc-b676-6d85879b482f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:01.550073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25c8ff-fa51-42bc-b676-6d85879b482f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:01.551488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25c8ff-fa51-42bc-b676-6d85879b482f service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:01.563463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:50:01.573254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 665/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:03.779646 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fc0ef-ad91-4915-8b4b-5b3b411a18fc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:03.780342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fc0ef-ad91-4915-8b4b-5b3b411a18fc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:03.780342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fc0ef-ad91-4915-8b4b-5b3b411a18fc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:03.781722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 670/1335] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:03.787913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66f98-eb69-45b0-9098-32936529ac7a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:03.788710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66f98-eb69-45b0-9098-32936529ac7a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:03.788894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66f98-eb69-45b0-9098-32936529ac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:03.879969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-39f66f98-eb69-45b0-9098-32936529ac7a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:03.881281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-39f66f98-eb69-45b0-9098-32936529ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:04.003527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 666/1336] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:50:04.047050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fc0ef-ad91-4915-8b4b-5b3b411a18fc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:04.048755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da7fc0ef-ad91-4915-8b4b-5b3b411a18fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:04.095335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:50:04.178683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fc0ef-ad91-4915-8b4b-5b3b411a18fc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:04.263491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d523ad-86f2-4488-aba8-b92b20df4a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:04.264499 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d523ad-86f2-4488-aba8-b92b20df4a2d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:04.264883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d523ad-86f2-4488-aba8-b92b20df4a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:04.265200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d523ad-86f2-4488-aba8-b92b20df4a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:04.267034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-43d523ad-86f2-4488-aba8-b92b20df4a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:04.363250 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:50:04.392547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d523ad-86f2-4488-aba8-b92b20df4a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:04.394024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d523ad-86f2-4488-aba8-b92b20df4a2d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:04.415561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 671/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:50:07.072054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5d975-4057-4c8b-b3b7-a09b839d6e99 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:07.072900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5d975-4057-4c8b-b3b7-a09b839d6e99 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:07.073082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5d975-4057-4c8b-b3b7-a09b839d6e99 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:07.074810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 667/1338] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:07.081596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da459e-cc9e-441b-9bed-a4d1bb5de3b2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:07.082323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da459e-cc9e-441b-9bed-a4d1bb5de3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:07.082323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da459e-cc9e-441b-9bed-a4d1bb5de3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:07.166930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e5da459e-cc9e-441b-9bed-a4d1bb5de3b2 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:07.168888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e5da459e-cc9e-441b-9bed-a4d1bb5de3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:07.310919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 672/1339] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:07.372381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5d975-4057-4c8b-b3b7-a09b839d6e99 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:07.374845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-45c5d975-4057-4c8b-b3b7-a09b839d6e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:07.474441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:50:07.494045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5d975-4057-4c8b-b3b7-a09b839d6e99 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:07.500201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50158e36-22e7-40c2-9f73-4a7e7575b70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:07.501029 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50158e36-22e7-40c2-9f73-4a7e7575b70f service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:07.501424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50158e36-22e7-40c2-9f73-4a7e7575b70f service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:07.501826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50158e36-22e7-40c2-9f73-4a7e7575b70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:07.515570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50158e36-22e7-40c2-9f73-4a7e7575b70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:07.519929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50158e36-22e7-40c2-9f73-4a7e7575b70f service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:07.535016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 668/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:50:12.577449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6007c5-4965-46fd-a595-da508a1cec71 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:12.578050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6007c5-4965-46fd-a595-da508a1cec71 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:12.578050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6007c5-4965-46fd-a595-da508a1cec71 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:12.579765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 673/1341] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:50:12.585304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8f7f-03bc-45e6-b877-13c9e8fd6e0b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:12.586057 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8f7f-03bc-45e6-b877-13c9e8fd6e0b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:12.586057 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8f7f-03bc-45e6-b877-13c9e8fd6e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:12.623282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f2cb8f7f-03bc-45e6-b877-13c9e8fd6e0b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:12.624608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f2cb8f7f-03bc-45e6-b877-13c9e8fd6e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:12.775417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 669/1342] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:12.813221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6007c5-4965-46fd-a595-da508a1cec71 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:12.815564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8b6007c5-4965-46fd-a595-da508a1cec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:12.832449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6007c5-4965-46fd-a595-da508a1cec71 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:12.835378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7a751-0398-421a-9ace-8a1189e32584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:12.836062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7a751-0398-421a-9ace-8a1189e32584 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:12.836348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7a751-0398-421a-9ace-8a1189e32584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:12.836633 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7a751-0398-421a-9ace-8a1189e32584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:12.847911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7a751-0398-421a-9ace-8a1189e32584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:12.849445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7a751-0398-421a-9ace-8a1189e32584 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:12.861261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 674/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:16.276495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdc8ca-6fcd-413e-b33d-896fe32d0a53 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:16.277839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdc8ca-6fcd-413e-b33d-896fe32d0a53 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:16.278063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdc8ca-6fcd-413e-b33d-896fe32d0a53 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:16.279812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 670/1344] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:16.287148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b1c62-ec37-4cbd-b777-93c899491e1a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:16.287831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b1c62-ec37-4cbd-b777-93c899491e1a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:16.288334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b1c62-ec37-4cbd-b777-93c899491e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:16.320124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6a3b1c62-ec37-4cbd-b777-93c899491e1a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:16.322218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6a3b1c62-ec37-4cbd-b777-93c899491e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:16.336387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 675/1345] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:16.396637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdc8ca-6fcd-413e-b33d-896fe32d0a53 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:16.413815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdc8ca-6fcd-413e-b33d-896fe32d0a53 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:16.420666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e0afc-1cbf-4698-a76b-13fa47fa923e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:16.421774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e0afc-1cbf-4698-a76b-13fa47fa923e service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:16.422286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e0afc-1cbf-4698-a76b-13fa47fa923e service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:16.422800 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e0afc-1cbf-4698-a76b-13fa47fa923e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:16.439666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e0afc-1cbf-4698-a76b-13fa47fa923e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:16.442488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e0afc-1cbf-4698-a76b-13fa47fa923e service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:16.461972 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 671/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:21.793393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1f23-00e0-4bef-a676-d9e67efe7c77 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:21.794245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1f23-00e0-4bef-a676-d9e67efe7c77 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:21.794245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1f23-00e0-4bef-a676-d9e67efe7c77 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:21.795457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 676/1347] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:50:21.802709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee169c-8cee-40b4-8719-407a19e21438 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:21.803585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee169c-8cee-40b4-8719-407a19e21438 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:21.803736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee169c-8cee-40b4-8719-407a19e21438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:21.831534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8cee169c-8cee-40b4-8719-407a19e21438 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:21.832958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8cee169c-8cee-40b4-8719-407a19e21438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:21.848025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 672/1348] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:50:21.911576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b1f23-00e0-4bef-a676-d9e67efe7c77 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:21.924585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b1f23-00e0-4bef-a676-d9e67efe7c77 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:21.928703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcf3f8-ee72-4356-a853-9455a2862bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:21.929405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcf3f8-ee72-4356-a853-9455a2862bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:21.929698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcf3f8-ee72-4356-a853-9455a2862bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:21.929982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcf3f8-ee72-4356-a853-9455a2862bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:21.945334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcf3f8-ee72-4356-a853-9455a2862bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:21.946841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcf3f8-ee72-4356-a853-9455a2862bd2 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:21.959557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 677/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:28.424789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290887b9-9ccb-4efc-8965-256b8e1db58b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:28.425576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290887b9-9ccb-4efc-8965-256b8e1db58b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:28.425722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290887b9-9ccb-4efc-8965-256b8e1db58b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:28.429838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 673/1350] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 15:50:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:28.438785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41026017-cce5-40dd-a747-d916e3e0aec1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:28.440466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41026017-cce5-40dd-a747-d916e3e0aec1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:28.441266 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41026017-cce5-40dd-a747-d916e3e0aec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:28.484607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:50:28.661336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-41026017-cce5-40dd-a747-d916e3e0aec1 None None] MFA Rules not processed for user `2d1aeacb83a142db99823f29bd1b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:28.662671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41026017-cce5-40dd-a747-d916e3e0aec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:28.773690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 678/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 15:50:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:50:31.824116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=57 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:50:35.022890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21914b94-d34a-4bf7-b67b-0883555773a0 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:35.023607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21914b94-d34a-4bf7-b67b-0883555773a0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:35.023607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21914b94-d34a-4bf7-b67b-0883555773a0 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:35.024967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 674/1352] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 15:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:35.031244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0436b-627c-4070-9efd-26d151bbb01b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:35.031786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0436b-627c-4070-9efd-26d151bbb01b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:35.031867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0436b-627c-4070-9efd-26d151bbb01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:35.059809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c9f0436b-627c-4070-9efd-26d151bbb01b None None] MFA Rules not processed for user `2d1aeacb83a142db99823f29bd1b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:35.061620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c9f0436b-627c-4070-9efd-26d151bbb01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:35.070926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 679/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 15:50:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:36.553051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dba5f-ba4d-41d6-b4e6-c95800c40dfb None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:36.553824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dba5f-ba4d-41d6-b4e6-c95800c40dfb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:36.553824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dba5f-ba4d-41d6-b4e6-c95800c40dfb None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:36.555130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 675/1354] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 15:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:36.561959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ef89d-51df-4b62-8400-d52724f899c0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:36.562499 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ef89d-51df-4b62-8400-d52724f899c0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:36.562797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ef89d-51df-4b62-8400-d52724f899c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:36.582848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-815ef89d-51df-4b62-8400-d52724f899c0 None None] MFA Rules not processed for user `2d1aeacb83a142db99823f29bd1b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:36.584524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-815ef89d-51df-4b62-8400-d52724f899c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:36.595715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 680/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 15:50:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:40.746062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bae79-38d6-4c15-8377-4766108cce3f None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:40.746710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bae79-38d6-4c15-8377-4766108cce3f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:40.747130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bae79-38d6-4c15-8377-4766108cce3f None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:40.749560 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 676/1356] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:40.756706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4e0a-6664-4d4c-8679-499f306485d8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:40.757378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4e0a-6664-4d4c-8679-499f306485d8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:40.757596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4e0a-6664-4d4c-8679-499f306485d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:40.777598 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-826d4e0a-6664-4d4c-8679-499f306485d8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:40.778828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-826d4e0a-6664-4d4c-8679-499f306485d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:40.790938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 681/1357] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:40.898244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e3fd5-c54d-454f-8bf8-44b8c3df31ab None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:40.900748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e3fd5-c54d-454f-8bf8-44b8c3df31ab None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:40.903413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e3fd5-c54d-454f-8bf8-44b8c3df31ab None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:40.911878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 677/1358] 10.222.0.46 () {54 vars in 961 bytes} [Tue Jun 21 15:50:40 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:40.952447 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cb2ce-4ab3-4331-9afb-ce543d0ccbad None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:40.952730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cb2ce-4ab3-4331-9afb-ce543d0ccbad None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:40.953106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cb2ce-4ab3-4331-9afb-ce543d0ccbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:41.026343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-da1cb2ce-4ab3-4331-9afb-ce543d0ccbad None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:41.028511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da1cb2ce-4ab3-4331-9afb-ce543d0ccbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:41.122905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:50:41.163284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 682/1359] 10.222.0.46 () {58 vars in 1058 bytes} [Tue Jun 21 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:50:41.178602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e3fd5-c54d-454f-8bf8-44b8c3df31ab None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:41.207882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e3fd5-c54d-454f-8bf8-44b8c3df31ab None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:41.219463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fcb3-bb41-473b-b44c-6c9eb57314f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:41.221035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fcb3-bb41-473b-b44c-6c9eb57314f1 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:41.222008 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fcb3-bb41-473b-b44c-6c9eb57314f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:41.222788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fcb3-bb41-473b-b44c-6c9eb57314f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:41.240577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fcb3-bb41-473b-b44c-6c9eb57314f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:41.244483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fcb3-bb41-473b-b44c-6c9eb57314f1 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:41.262632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 678/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:44.148502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a923a-8124-4d88-9229-a2b7b8230569 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:44.149202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a923a-8124-4d88-9229-a2b7b8230569 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:44.149950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a923a-8124-4d88-9229-a2b7b8230569 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:44.153159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 683/1361] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:44.164208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546605e-346c-44e5-96c3-5161376f7635 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:44.164940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546605e-346c-44e5-96c3-5161376f7635 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:44.165139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546605e-346c-44e5-96c3-5161376f7635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:44.206484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7546605e-346c-44e5-96c3-5161376f7635 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:44.208894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7546605e-346c-44e5-96c3-5161376f7635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:44.224636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 679/1362] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:50:44.310867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a923a-8124-4d88-9229-a2b7b8230569 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:44.334291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a923a-8124-4d88-9229-a2b7b8230569 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:44.347505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d2606-553f-49e2-bc0d-a7ce27d56106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:44.348966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d2606-553f-49e2-bc0d-a7ce27d56106 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:44.349500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d2606-553f-49e2-bc0d-a7ce27d56106 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:44.350221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d2606-553f-49e2-bc0d-a7ce27d56106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:44.371244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d2606-553f-49e2-bc0d-a7ce27d56106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:44.373989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d2606-553f-49e2-bc0d-a7ce27d56106 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:44.397038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 684/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:47.344582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6b27b-5b18-4436-9514-964489ee4905 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:47.345275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6b27b-5b18-4436-9514-964489ee4905 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:47.345401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6b27b-5b18-4436-9514-964489ee4905 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:47.346868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 680/1364] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:47.353246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb30d-28ce-4c49-81ed-8edf780acb09 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:47.354144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb30d-28ce-4c49-81ed-8edf780acb09 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:47.354144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42deb30d-28ce-4c49-81ed-8edf780acb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:47.376041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-42deb30d-28ce-4c49-81ed-8edf780acb09 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:47.377459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42deb30d-28ce-4c49-81ed-8edf780acb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:47.387931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 685/1365] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:50:47.443529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102e28d-a8fd-4fd5-bcad-21bdb8f16ee2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:47.444372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102e28d-a8fd-4fd5-bcad-21bdb8f16ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:47.444924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102e28d-a8fd-4fd5-bcad-21bdb8f16ee2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:47.447690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 681/1366] 10.222.0.46 () {54 vars in 961 bytes} [Tue Jun 21 15:50:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:47.455534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ca9c3-57e7-43e9-bae6-6dc06137b451 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:47.455942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ca9c3-57e7-43e9-bae6-6dc06137b451 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:47.456195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ca9c3-57e7-43e9-bae6-6dc06137b451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:47.478156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e61ca9c3-57e7-43e9-bae6-6dc06137b451 None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:47.479595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e61ca9c3-57e7-43e9-bae6-6dc06137b451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:47.490137 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 686/1367] 10.222.0.46 () {58 vars in 1058 bytes} [Tue Jun 21 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:47.499929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102e28d-a8fd-4fd5-bcad-21bdb8f16ee2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:47.527262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102e28d-a8fd-4fd5-bcad-21bdb8f16ee2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:47.540932 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a907a0b-cbba-4443-a332-fd89baa3ccaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:47.542460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a907a0b-cbba-4443-a332-fd89baa3ccaf service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:47.542908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a907a0b-cbba-4443-a332-fd89baa3ccaf service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:47.543330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a907a0b-cbba-4443-a332-fd89baa3ccaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:47.559216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a907a0b-cbba-4443-a332-fd89baa3ccaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:47.562236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a907a0b-cbba-4443-a332-fd89baa3ccaf service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:47.583510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 682/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:50.113199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035f4c-41a5-4dff-a666-38b4c8c4688c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:50.114333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035f4c-41a5-4dff-a666-38b4c8c4688c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:50.114874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035f4c-41a5-4dff-a666-38b4c8c4688c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:50.116486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 687/1369] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:50.123607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915f196-bb7f-4f72-b5bc-6cf63ee50ddc None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:50.124463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915f196-bb7f-4f72-b5bc-6cf63ee50ddc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:50.124463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915f196-bb7f-4f72-b5bc-6cf63ee50ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:50.148591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0915f196-bb7f-4f72-b5bc-6cf63ee50ddc None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:50.150701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0915f196-bb7f-4f72-b5bc-6cf63ee50ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:50.173313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 683/1370] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:50:50.249045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5035f4c-41a5-4dff-a666-38b4c8c4688c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:50.271808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5035f4c-41a5-4dff-a666-38b4c8c4688c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:50.279432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5d2f6-65a8-4cfe-99db-7c41f44baea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:50.280203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5d2f6-65a8-4cfe-99db-7c41f44baea6 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:50.280884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5d2f6-65a8-4cfe-99db-7c41f44baea6 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:50.281221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5d2f6-65a8-4cfe-99db-7c41f44baea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:50.292619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5d2f6-65a8-4cfe-99db-7c41f44baea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:50.294598 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5d2f6-65a8-4cfe-99db-7c41f44baea6 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:50.307659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 688/1371] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:50.915228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083fd38-e3cf-4222-a8de-08af221bce71 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:50.915519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083fd38-e3cf-4222-a8de-08af221bce71 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:50.915731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083fd38-e3cf-4222-a8de-08af221bce71 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:50.921535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 684/1372] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:50:50.923742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10086c-3a8c-4272-adcf-ee29e9bc72c1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:50.923979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10086c-3a8c-4272-adcf-ee29e9bc72c1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:50.924257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10086c-3a8c-4272-adcf-ee29e9bc72c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:50.950953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cc10086c-3a8c-4272-adcf-ee29e9bc72c1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:50.952549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cc10086c-3a8c-4272-adcf-ee29e9bc72c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:50.967653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 689/1373] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:51.286052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f102c-75f0-4b08-90b6-3ad218d5de7c None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:51.286680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f102c-75f0-4b08-90b6-3ad218d5de7c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:51.286680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f102c-75f0-4b08-90b6-3ad218d5de7c None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:51.288086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 685/1374] 10.222.0.46 () {54 vars in 963 bytes} [Tue Jun 21 15:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:51.295396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e23a6d-e918-4c91-90bb-a5f11e637562 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:51.296527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e23a6d-e918-4c91-90bb-a5f11e637562 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:51.297082 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e23a6d-e918-4c91-90bb-a5f11e637562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:51.383506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-41e23a6d-e918-4c91-90bb-a5f11e637562 None None] MFA Rules not processed for user `6087f9fd3f814573a243f983faf0ce5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:51.384995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41e23a6d-e918-4c91-90bb-a5f11e637562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:51.500033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 690/1375] 10.222.0.46 () {58 vars in 1060 bytes} [Tue Jun 21 15:50:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:51.514871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f102c-75f0-4b08-90b6-3ad218d5de7c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:51.535353 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f102c-75f0-4b08-90b6-3ad218d5de7c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:51.542591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d32ec-8a3c-4db9-b20e-2b49fd10f4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:51.543977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d32ec-8a3c-4db9-b20e-2b49fd10f4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:51.544575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d32ec-8a3c-4db9-b20e-2b49fd10f4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:51.545155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d32ec-8a3c-4db9-b20e-2b49fd10f4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:51.564459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d32ec-8a3c-4db9-b20e-2b49fd10f4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:51.567464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d32ec-8a3c-4db9-b20e-2b49fd10f4d7 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:51.586846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 686/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:53.082865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be223d75-13ed-47d1-8848-ed6110ca5a41 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:53.083977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be223d75-13ed-47d1-8848-ed6110ca5a41 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:53.084448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be223d75-13ed-47d1-8848-ed6110ca5a41 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:53.086028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 691/1377] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:53.093795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f79ef-cc1f-4113-b125-bb7b2ea1f18e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:53.094650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f79ef-cc1f-4113-b125-bb7b2ea1f18e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:53.094794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f79ef-cc1f-4113-b125-bb7b2ea1f18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:53.118526 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-700f79ef-cc1f-4113-b125-bb7b2ea1f18e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:53.120707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-700f79ef-cc1f-4113-b125-bb7b2ea1f18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:53.136336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 687/1378] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:53.211949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be223d75-13ed-47d1-8848-ed6110ca5a41 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:53.229025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be223d75-13ed-47d1-8848-ed6110ca5a41 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:53.235890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633d9f2-3adf-47eb-9d52-1219f603c2c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:53.236571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d9f2-3adf-47eb-9d52-1219f603c2c7 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:53.236865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d9f2-3adf-47eb-9d52-1219f603c2c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:53.237155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d9f2-3adf-47eb-9d52-1219f603c2c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:53.247768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633d9f2-3adf-47eb-9d52-1219f603c2c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:53.249637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633d9f2-3adf-47eb-9d52-1219f603c2c7 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:53.264724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 692/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:55.759687 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0f9d9-e0b7-46ff-92f7-5fd95dce2977 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:55.761006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0f9d9-e0b7-46ff-92f7-5fd95dce2977 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:55.761162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0f9d9-e0b7-46ff-92f7-5fd95dce2977 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:55.763717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 688/1380] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:55.773502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03403922-440c-44f7-bb92-96995c46c974 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:55.774083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03403922-440c-44f7-bb92-96995c46c974 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:55.774500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03403922-440c-44f7-bb92-96995c46c974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:55.805173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-03403922-440c-44f7-bb92-96995c46c974 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:55.807023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-03403922-440c-44f7-bb92-96995c46c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:55.817895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 693/1381] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:55.872463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0f9d9-e0b7-46ff-92f7-5fd95dce2977 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:55.889265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0f9d9-e0b7-46ff-92f7-5fd95dce2977 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:55.896162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a514397-a290-4a15-8018-99b4169d0d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:55.896827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514397-a290-4a15-8018-99b4169d0d7e service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:55.897115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514397-a290-4a15-8018-99b4169d0d7e service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:55.897392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a514397-a290-4a15-8018-99b4169d0d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:55.907847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a514397-a290-4a15-8018-99b4169d0d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:55.910016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a514397-a290-4a15-8018-99b4169d0d7e service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:55.922690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 689/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:50:58.330884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eae74-485f-40ce-b1fe-5095ff962eca None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:58.331700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eae74-485f-40ce-b1fe-5095ff962eca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:58.331700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eae74-485f-40ce-b1fe-5095ff962eca None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:58.332931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 694/1383] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:50:58.338948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662bf7f-f1a1-445b-a7e2-15e822d04b2a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:58.340233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662bf7f-f1a1-445b-a7e2-15e822d04b2a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:58.340233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662bf7f-f1a1-445b-a7e2-15e822d04b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:58.359150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0662bf7f-f1a1-445b-a7e2-15e822d04b2a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:50:58.360926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0662bf7f-f1a1-445b-a7e2-15e822d04b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:50:58.371754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 690/1384] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:50:58.426327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380eae74-485f-40ce-b1fe-5095ff962eca None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:50:58.449970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380eae74-485f-40ce-b1fe-5095ff962eca None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:50:58.456641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0929a-1a22-4b5e-aa8b-8dc1fdc8cb40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:50:58.457544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0929a-1a22-4b5e-aa8b-8dc1fdc8cb40 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:50:58.458045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0929a-1a22-4b5e-aa8b-8dc1fdc8cb40 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:50:58.458478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0929a-1a22-4b5e-aa8b-8dc1fdc8cb40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:50:58.470167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0929a-1a22-4b5e-aa8b-8dc1fdc8cb40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:50:58.472084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0929a-1a22-4b5e-aa8b-8dc1fdc8cb40 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:50:58.485356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 695/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:00.927398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3aec-77c0-468f-abca-8bf36e75d423 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:00.928807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3aec-77c0-468f-abca-8bf36e75d423 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:00.928807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3aec-77c0-468f-abca-8bf36e75d423 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:00.942669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21120409-e8a5-4bcb-b1f9-d1c1b9f46b1a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:00.942669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21120409-e8a5-4bcb-b1f9-d1c1b9f46b1a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:00.942669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21120409-e8a5-4bcb-b1f9-d1c1b9f46b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:00.949899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 691/1386] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:51:00 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:00.973001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-21120409-e8a5-4bcb-b1f9-d1c1b9f46b1a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:00.975342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21120409-e8a5-4bcb-b1f9-d1c1b9f46b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:00.991185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 696/1387] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:01.101199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f3aec-77c0-468f-abca-8bf36e75d423 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:01.134799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f3aec-77c0-468f-abca-8bf36e75d423 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:01.153147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016a9d4-188b-4948-a64d-e08e4582227f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:01.153147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016a9d4-188b-4948-a64d-e08e4582227f service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:01.154197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016a9d4-188b-4948-a64d-e08e4582227f service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:01.154197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016a9d4-188b-4948-a64d-e08e4582227f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:01.172435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016a9d4-188b-4948-a64d-e08e4582227f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:01.175614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016a9d4-188b-4948-a64d-e08e4582227f service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:01.196287 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 692/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:03.653585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a5ed2-a029-45a1-9287-b2ff7c3d916c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:03.655459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a5ed2-a029-45a1-9287-b2ff7c3d916c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:03.655459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a5ed2-a029-45a1-9287-b2ff7c3d916c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:03.656004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 697/1389] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:51:03.662151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b30efb-295d-4e7d-ac29-0c2f72778394 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:03.662730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b30efb-295d-4e7d-ac29-0c2f72778394 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:03.662730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b30efb-295d-4e7d-ac29-0c2f72778394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:03.670377 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=43 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:51:03.684411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-84b30efb-295d-4e7d-ac29-0c2f72778394 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:03.685830 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-84b30efb-295d-4e7d-ac29-0c2f72778394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:03.695150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 693/1390] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:51:03.745622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a5ed2-a029-45a1-9287-b2ff7c3d916c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:03.780062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a5ed2-a029-45a1-9287-b2ff7c3d916c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:03.796518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41075050-9a88-4582-997e-ede53fb577c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:03.797375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41075050-9a88-4582-997e-ede53fb577c2 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:03.797707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41075050-9a88-4582-997e-ede53fb577c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:03.798185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41075050-9a88-4582-997e-ede53fb577c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:03.815868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41075050-9a88-4582-997e-ede53fb577c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:03.817050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41075050-9a88-4582-997e-ede53fb577c2 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:03.828887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 698/1391] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:06.338724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797525b1-00fb-47de-a0de-6cbd5da58d51 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:06.339351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797525b1-00fb-47de-a0de-6cbd5da58d51 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:06.339351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797525b1-00fb-47de-a0de-6cbd5da58d51 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:06.340743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 694/1392] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:06.346922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f0c7-814d-4c93-b02c-cca251659501 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:06.347543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f0c7-814d-4c93-b02c-cca251659501 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:06.347543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f0c7-814d-4c93-b02c-cca251659501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:06.368708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3392f0c7-814d-4c93-b02c-cca251659501 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:06.370181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3392f0c7-814d-4c93-b02c-cca251659501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:06.379321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 699/1393] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:06.427367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797525b1-00fb-47de-a0de-6cbd5da58d51 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:06.445150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797525b1-00fb-47de-a0de-6cbd5da58d51 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:06.452939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275450a7-1aed-45b5-aa68-17618c3816fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:06.453809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275450a7-1aed-45b5-aa68-17618c3816fe service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:06.454215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275450a7-1aed-45b5-aa68-17618c3816fe service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:06.454581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275450a7-1aed-45b5-aa68-17618c3816fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:06.467417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275450a7-1aed-45b5-aa68-17618c3816fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:06.470268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275450a7-1aed-45b5-aa68-17618c3816fe service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:06.486685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 695/1394] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:51:08.694833 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f055b-50e8-405b-b974-8f0edb0189d3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:08.695659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f055b-50e8-405b-b974-8f0edb0189d3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:08.695659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f055b-50e8-405b-b974-8f0edb0189d3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:08.696996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 700/1395] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:51:08.703792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca76f3f-8de6-401e-806e-9de1a53b560c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:08.704352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca76f3f-8de6-401e-806e-9de1a53b560c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:08.704352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca76f3f-8de6-401e-806e-9de1a53b560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:08.722753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0ca76f3f-8de6-401e-806e-9de1a53b560c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:08.724018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0ca76f3f-8de6-401e-806e-9de1a53b560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:08.733871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 696/1396] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:08.782955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f055b-50e8-405b-b974-8f0edb0189d3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:08.799870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f055b-50e8-405b-b974-8f0edb0189d3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:08.805711 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88ddb5-da72-4b42-b7ed-6c101afcf70e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:08.806477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88ddb5-da72-4b42-b7ed-6c101afcf70e service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:08.806775 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88ddb5-da72-4b42-b7ed-6c101afcf70e service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:08.807900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88ddb5-da72-4b42-b7ed-6c101afcf70e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:08.818037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88ddb5-da72-4b42-b7ed-6c101afcf70e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:08.819723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88ddb5-da72-4b42-b7ed-6c101afcf70e service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:08.831107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 701/1397] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:09.372768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13143ce-b0e1-416b-a97d-d194fcc7d3e0 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:09.373279 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13143ce-b0e1-416b-a97d-d194fcc7d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:09.373789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13143ce-b0e1-416b-a97d-d194fcc7d3e0 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:09.376517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 697/1398] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:51:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:09.382751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6847500-7369-4548-a006-8cb2f7602f82 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:09.383043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6847500-7369-4548-a006-8cb2f7602f82 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:09.383418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6847500-7369-4548-a006-8cb2f7602f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:09.397759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:51:09.410893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e6847500-7369-4548-a006-8cb2f7602f82 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:09.412214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6847500-7369-4548-a006-8cb2f7602f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:09.423149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 702/1399] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:09.498175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b833f-24c8-431b-a4e9-e387387dc76d None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:09.498175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b833f-24c8-431b-a4e9-e387387dc76d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:09.498175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b833f-24c8-431b-a4e9-e387387dc76d None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:09.500328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 698/1400] 10.222.0.46 () {54 vars in 962 bytes} [Tue Jun 21 15:51:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:51:09.508733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b4189-034a-498c-a033-2b4e3778454c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:09.509199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b4189-034a-498c-a033-2b4e3778454c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:09.509571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b4189-034a-498c-a033-2b4e3778454c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:09.578635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ba4b4189-034a-498c-a033-2b4e3778454c None None] MFA Rules not processed for user `61565364dbac41cfac76195c0be88771`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:09.579990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ba4b4189-034a-498c-a033-2b4e3778454c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:09.676546 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 703/1401] 10.222.0.46 () {58 vars in 1059 bytes} [Tue Jun 21 15:51:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:51:09.685112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b833f-24c8-431b-a4e9-e387387dc76d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:09.698334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b833f-24c8-431b-a4e9-e387387dc76d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:09.708342 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e818f-6fee-4323-9a8a-817990199c60 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61565364dbac41cfac76195c0be88771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:09.709422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e818f-6fee-4323-9a8a-817990199c60 service glance] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:09.709422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e818f-6fee-4323-9a8a-817990199c60 service glance] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:09.709743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e818f-6fee-4323-9a8a-817990199c60 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:09.727516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e818f-6fee-4323-9a8a-817990199c60 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:09.729827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e818f-6fee-4323-9a8a-817990199c60 service glance] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:09.742188 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 699/1402] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:10.660215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8a2b-456a-49a2-9f18-b25828149404 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:10.660898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8a2b-456a-49a2-9f18-b25828149404 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:10.660898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8a2b-456a-49a2-9f18-b25828149404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:10.749630 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e49d8a2b-456a-49a2-9f18-b25828149404 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:10.750923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e49d8a2b-456a-49a2-9f18-b25828149404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:10.834759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 704/1403] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 15:51:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:10.893312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca34eac-1f62-48d3-81a0-7201fdd9734b None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:10.894017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca34eac-1f62-48d3-81a0-7201fdd9734b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:10.894017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca34eac-1f62-48d3-81a0-7201fdd9734b None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:10.895396 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 700/1404] 10.222.0.46 () {54 vars in 942 bytes} [Tue Jun 21 15:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:51:10.903967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eb39a-3e1e-440e-9ae0-b4515826a549 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:10.904275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eb39a-3e1e-440e-9ae0-b4515826a549 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:10.904614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eb39a-3e1e-440e-9ae0-b4515826a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:10.976856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d66eb39a-3e1e-440e-9ae0-b4515826a549 None None] MFA Rules not processed for user `35ec9ea691c141eb86bf7a825fbb80ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:10.978317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d66eb39a-3e1e-440e-9ae0-b4515826a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:11.003012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:51:11.064425 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 705/1405] 10.222.0.46 () {58 vars in 1039 bytes} [Tue Jun 21 15:51:10 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:51:11.079634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca34eac-1f62-48d3-81a0-7201fdd9734b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:11.096125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca34eac-1f62-48d3-81a0-7201fdd9734b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:11.106160 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8915a-2bea-4eb4-b812-4995d8f6fe9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:11.107064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8915a-2bea-4eb4-b812-4995d8f6fe9a service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:11.107471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8915a-2bea-4eb4-b812-4995d8f6fe9a service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:11.107839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8915a-2bea-4eb4-b812-4995d8f6fe9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:11.118291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8915a-2bea-4eb4-b812-4995d8f6fe9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:11.121486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8915a-2bea-4eb4-b812-4995d8f6fe9a service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:11.131533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 701/1406] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 15:51:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:51:11.149608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdd61-cca0-491e-a53e-a705921ab902 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:11.149782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdd61-cca0-491e-a53e-a705921ab902 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:11.150051 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdd61-cca0-491e-a53e-a705921ab902 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:11.152279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 706/1407] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:11.158580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddaced-3b67-4380-a19e-bff107810011 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:11.158981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddaced-3b67-4380-a19e-bff107810011 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:11.159325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddaced-3b67-4380-a19e-bff107810011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:11.185390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-71ddaced-3b67-4380-a19e-bff107810011 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:11.186650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-71ddaced-3b67-4380-a19e-bff107810011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:11.195686 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 702/1408] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:11.252565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdd61-cca0-491e-a53e-a705921ab902 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:11.282914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdd61-cca0-491e-a53e-a705921ab902 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:11.294473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a67eac-c165-48bc-855a-d184ae295219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:11.296065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67eac-c165-48bc-855a-d184ae295219 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:11.296804 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67eac-c165-48bc-855a-d184ae295219 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:11.297273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a67eac-c165-48bc-855a-d184ae295219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:11.322530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a67eac-c165-48bc-855a-d184ae295219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:11.325820 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a67eac-c165-48bc-855a-d184ae295219 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:11.346623 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 707/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:51:21.177984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=26 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:51:21.336253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=28 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:51:35.496312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654029ea-fc9f-416c-9ce3-093d74562487 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:35.496936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654029ea-fc9f-416c-9ce3-093d74562487 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:35.496936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654029ea-fc9f-416c-9ce3-093d74562487 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:35.498340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 703/1410] 10.222.0.46 () {54 vars in 918 bytes} [Tue Jun 21 15:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:35.505126 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f468b-4f67-4cae-83b5-7f0f282a7b8a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:35.505726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f468b-4f67-4cae-83b5-7f0f282a7b8a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:35.505865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f468b-4f67-4cae-83b5-7f0f282a7b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:35.536398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f45f468b-4f67-4cae-83b5-7f0f282a7b8a None None] MFA Rules not processed for user `2d1aeacb83a142db99823f29bd1b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:35.537999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f45f468b-4f67-4cae-83b5-7f0f282a7b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:35.552770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 708/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Jun 21 15:51:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:51:35.572414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee127d-5b07-42ff-9fed-53f11e495e48 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:35.572881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee127d-5b07-42ff-9fed-53f11e495e48 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:35.573176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee127d-5b07-42ff-9fed-53f11e495e48 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:35.574655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 704/1412] 10.222.0.46 () {54 vars in 918 bytes} [Tue Jun 21 15:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:51:35.582425 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41415897-d362-4218-9fbe-bfe2f7684e0a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:35.582939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41415897-d362-4218-9fbe-bfe2f7684e0a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:35.583495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41415897-d362-4218-9fbe-bfe2f7684e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:35.623338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-41415897-d362-4218-9fbe-bfe2f7684e0a None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:35.625640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41415897-d362-4218-9fbe-bfe2f7684e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:35.641888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 709/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Jun 21 15:51:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:38.332425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe10800-98c1-4612-be23-bf1d7ec0b4e6 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:38.333146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe10800-98c1-4612-be23-bf1d7ec0b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:38.333146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe10800-98c1-4612-be23-bf1d7ec0b4e6 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:38.334386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:38.340861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14112a33-d92a-4072-8eb2-68c1f81e03f8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:38.341728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14112a33-d92a-4072-8eb2-68c1f81e03f8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:38.341926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14112a33-d92a-4072-8eb2-68c1f81e03f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:38.362588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-14112a33-d92a-4072-8eb2-68c1f81e03f8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:38.363864 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-14112a33-d92a-4072-8eb2-68c1f81e03f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:38.372665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:51:38.423116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe10800-98c1-4612-be23-bf1d7ec0b4e6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:38.440184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe10800-98c1-4612-be23-bf1d7ec0b4e6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:38.445814 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01af30-5579-44ee-9912-5212fa74834b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:38.446447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01af30-5579-44ee-9912-5212fa74834b service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:38.447289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01af30-5579-44ee-9912-5212fa74834b service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:38.447573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01af30-5579-44ee-9912-5212fa74834b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:38.457160 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01af30-5579-44ee-9912-5212fa74834b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:38.458747 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01af30-5579-44ee-9912-5212fa74834b service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:38.470359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 706/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:39.457982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8203ff-f7ab-4d13-ae1d-5157307ae71a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:39.458765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8203ff-f7ab-4d13-ae1d-5157307ae71a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:39.458765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8203ff-f7ab-4d13-ae1d-5157307ae71a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:39.460280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:39.466911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6246-4088-4946-933d-0ef31d86e562 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:39.467523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6246-4088-4946-933d-0ef31d86e562 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:39.467633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6246-4088-4946-933d-0ef31d86e562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:39.487773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3b8b6246-4088-4946-933d-0ef31d86e562 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:39.489025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3b8b6246-4088-4946-933d-0ef31d86e562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:39.498196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:39.660158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8203ff-f7ab-4d13-ae1d-5157307ae71a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:39.675702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8203ff-f7ab-4d13-ae1d-5157307ae71a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:39.681968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814886a-aec2-4da0-9a61-252a20a609ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:39.682651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814886a-aec2-4da0-9a61-252a20a609ca service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:39.682956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814886a-aec2-4da0-9a61-252a20a609ca service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:39.683269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814886a-aec2-4da0-9a61-252a20a609ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:39.692631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814886a-aec2-4da0-9a61-252a20a609ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:39.694367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814886a-aec2-4da0-9a61-252a20a609ca service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:39.706436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 712/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:40.687107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ac432-be7b-463f-87e3-bb4b67097f4a None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:40.687772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ac432-be7b-463f-87e3-bb4b67097f4a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:40.687772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ac432-be7b-463f-87e3-bb4b67097f4a None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:40.689164 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:40.695474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43942254-2947-4444-ba01-67e67234ca07 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:40.696091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43942254-2947-4444-ba01-67e67234ca07 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:40.696348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43942254-2947-4444-ba01-67e67234ca07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:40.723025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-43942254-2947-4444-ba01-67e67234ca07 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:40.724754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-43942254-2947-4444-ba01-67e67234ca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:40.734026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:40.906612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ac432-be7b-463f-87e3-bb4b67097f4a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:40.931840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ac432-be7b-463f-87e3-bb4b67097f4a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:40.940310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb8c7a-e0c6-47b2-b336-1ee3fd271da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:40.940939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8c7a-e0c6-47b2-b336-1ee3fd271da0 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:40.941230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8c7a-e0c6-47b2-b336-1ee3fd271da0 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:40.941514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb8c7a-e0c6-47b2-b336-1ee3fd271da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:40.952006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb8c7a-e0c6-47b2-b336-1ee3fd271da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:40.953921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb8c7a-e0c6-47b2-b336-1ee3fd271da0 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:40.966306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 709/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:51:41.953079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550b518-79da-449a-b6d6-7dea63e83dc4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:41.953718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550b518-79da-449a-b6d6-7dea63e83dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:41.953851 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550b518-79da-449a-b6d6-7dea63e83dc4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:41.955360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:51:41.961204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e8839-e1be-4760-ab76-2cae06c5abb3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:41.961821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e8839-e1be-4760-ab76-2cae06c5abb3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:41.961821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e8839-e1be-4760-ab76-2cae06c5abb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:41.983057 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-cf0e8839-e1be-4760-ab76-2cae06c5abb3 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:41.984638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cf0e8839-e1be-4760-ab76-2cae06c5abb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:41.994326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:51:42.167226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550b518-79da-449a-b6d6-7dea63e83dc4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:42.187902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550b518-79da-449a-b6d6-7dea63e83dc4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:42.194539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53475ab1-87be-4745-bca4-58fdc6cb21b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:42.195526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53475ab1-87be-4745-bca4-58fdc6cb21b6 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:42.195812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53475ab1-87be-4745-bca4-58fdc6cb21b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:42.196089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53475ab1-87be-4745-bca4-58fdc6cb21b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:42.211495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53475ab1-87be-4745-bca4-58fdc6cb21b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:42.214605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53475ab1-87be-4745-bca4-58fdc6cb21b6 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:42.231927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 715/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:51:43.221136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb58024-c726-4f39-b04f-20656a97aa1e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:43.221729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb58024-c726-4f39-b04f-20656a97aa1e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:43.222048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb58024-c726-4f39-b04f-20656a97aa1e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:43.224761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:51:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:43.232539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245aead3-4882-45e7-bf1b-efd76c59cacd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:43.233394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245aead3-4882-45e7-bf1b-efd76c59cacd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:43.233557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245aead3-4882-45e7-bf1b-efd76c59cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:43.255144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-245aead3-4882-45e7-bf1b-efd76c59cacd None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:43.256470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-245aead3-4882-45e7-bf1b-efd76c59cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:43.266456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:51:43.427250 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb58024-c726-4f39-b04f-20656a97aa1e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:43.443210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb58024-c726-4f39-b04f-20656a97aa1e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:43.449956 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc837-9cd8-42d2-9844-6c6159409125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:43.450634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc837-9cd8-42d2-9844-6c6159409125 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:43.450923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc837-9cd8-42d2-9844-6c6159409125 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:43.451324 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc837-9cd8-42d2-9844-6c6159409125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:43.461205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfc837-9cd8-42d2-9844-6c6159409125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:43.464007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfc837-9cd8-42d2-9844-6c6159409125 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:43.475447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 712/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:51:44.391710 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea8c1f-fe68-452b-9e4a-5b22876080b0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:44.392252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea8c1f-fe68-452b-9e4a-5b22876080b0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:44.392252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea8c1f-fe68-452b-9e4a-5b22876080b0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:44.393659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:44.399069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f8688-dabf-4394-9e43-5b0f3a9214c5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:44.399624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f8688-dabf-4394-9e43-5b0f3a9214c5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:44.399716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f8688-dabf-4394-9e43-5b0f3a9214c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:44.419500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b30f8688-dabf-4394-9e43-5b0f3a9214c5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:44.420615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b30f8688-dabf-4394-9e43-5b0f3a9214c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:44.429167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:44.589766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea8c1f-fe68-452b-9e4a-5b22876080b0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:44.606138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea8c1f-fe68-452b-9e4a-5b22876080b0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:44.611874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d90d2-459f-4373-bdce-00483c97e8aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:44.612543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d90d2-459f-4373-bdce-00483c97e8aa service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:44.612827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d90d2-459f-4373-bdce-00483c97e8aa service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:44.613102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d90d2-459f-4373-bdce-00483c97e8aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:44.623472 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d90d2-459f-4373-bdce-00483c97e8aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:44.625221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d90d2-459f-4373-bdce-00483c97e8aa service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:44.636784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 718/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:45.511754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4536d0-d5a1-4fcb-9866-cd330774e8f0 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:45.512431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4536d0-d5a1-4fcb-9866-cd330774e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:45.512431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4536d0-d5a1-4fcb-9866-cd330774e8f0 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:45.513949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:45.520043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f20a11-7c2f-4794-9ef5-30a76fe44a31 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:45.520662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f20a11-7c2f-4794-9ef5-30a76fe44a31 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:45.520662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f20a11-7c2f-4794-9ef5-30a76fe44a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:45.543433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-12f20a11-7c2f-4794-9ef5-30a76fe44a31 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:45.544874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-12f20a11-7c2f-4794-9ef5-30a76fe44a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:45.554650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:45.723056 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4536d0-d5a1-4fcb-9866-cd330774e8f0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:45.740339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4536d0-d5a1-4fcb-9866-cd330774e8f0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:45.749715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148f2c-4ef7-4e0a-9c71-4658e8494bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:45.750442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148f2c-4ef7-4e0a-9c71-4658e8494bf9 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:45.750769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148f2c-4ef7-4e0a-9c71-4658e8494bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:45.751103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148f2c-4ef7-4e0a-9c71-4658e8494bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:45.762086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148f2c-4ef7-4e0a-9c71-4658e8494bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:45.763852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148f2c-4ef7-4e0a-9c71-4658e8494bf9 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:45.776469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 715/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:46.688965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281dc2f-600f-43b8-a1cf-b71813d5380f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:46.689649 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281dc2f-600f-43b8-a1cf-b71813d5380f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:46.689969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281dc2f-600f-43b8-a1cf-b71813d5380f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:46.692677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:51:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:51:46.701593 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b57ada-c3ca-4094-94bc-453c1c819021 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:46.702278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b57ada-c3ca-4094-94bc-453c1c819021 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:46.702278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b57ada-c3ca-4094-94bc-453c1c819021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:46.721634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e9b57ada-c3ca-4094-94bc-453c1c819021 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:46.723131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e9b57ada-c3ca-4094-94bc-453c1c819021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:46.733494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:46.902054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281dc2f-600f-43b8-a1cf-b71813d5380f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:46.919347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281dc2f-600f-43b8-a1cf-b71813d5380f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:46.925323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64127a67-6e44-451c-b134-79d5588dd1c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:46.925996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64127a67-6e44-451c-b134-79d5588dd1c3 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:46.926289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64127a67-6e44-451c-b134-79d5588dd1c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:46.926568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64127a67-6e44-451c-b134-79d5588dd1c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:46.937912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64127a67-6e44-451c-b134-79d5588dd1c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:46.939662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64127a67-6e44-451c-b134-79d5588dd1c3 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:46.951897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 721/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:47.866659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7bc7-bc78-424e-9078-c301f86d154a None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:47.867282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7bc7-bc78-424e-9078-c301f86d154a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:47.867282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7bc7-bc78-424e-9078-c301f86d154a None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:47.869784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:47.875847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf92472-2730-4d5e-b221-083d624beb5b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:47.876664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf92472-2730-4d5e-b221-083d624beb5b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:47.876859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf92472-2730-4d5e-b221-083d624beb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:47.898516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bbf92472-2730-4d5e-b221-083d624beb5b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:47.900485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bbf92472-2730-4d5e-b221-083d624beb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:47.908894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:51:48.073407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7bc7-bc78-424e-9078-c301f86d154a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:48.090139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7bc7-bc78-424e-9078-c301f86d154a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:48.097456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637cf01-7e73-4c29-847b-4788fcc77a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:48.098272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637cf01-7e73-4c29-847b-4788fcc77a60 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:48.098645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637cf01-7e73-4c29-847b-4788fcc77a60 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:48.099289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637cf01-7e73-4c29-847b-4788fcc77a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:48.111628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637cf01-7e73-4c29-847b-4788fcc77a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:48.113324 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637cf01-7e73-4c29-847b-4788fcc77a60 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:48.125506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 718/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:50.217625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c655834-a7df-4271-afbe-0c0de8614a33 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:50.218171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c655834-a7df-4271-afbe-0c0de8614a33 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:50.218171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c655834-a7df-4271-afbe-0c0de8614a33 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:50.219654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:51:50.225689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9795-c9ee-431f-a1d4-8c5b08275283 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:50.226261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9795-c9ee-431f-a1d4-8c5b08275283 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:50.226420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9795-c9ee-431f-a1d4-8c5b08275283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:50.248601 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-dbcd9795-c9ee-431f-a1d4-8c5b08275283 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:50.249892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dbcd9795-c9ee-431f-a1d4-8c5b08275283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:50.258344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:50.300464 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c655834-a7df-4271-afbe-0c0de8614a33 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:50.312099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c655834-a7df-4271-afbe-0c0de8614a33 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:50.315811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38754d9a-80d0-46ec-8b64-6ddcaf1f251d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:50.316472 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38754d9a-80d0-46ec-8b64-6ddcaf1f251d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:50.316755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38754d9a-80d0-46ec-8b64-6ddcaf1f251d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:50.317024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38754d9a-80d0-46ec-8b64-6ddcaf1f251d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:50.327212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38754d9a-80d0-46ec-8b64-6ddcaf1f251d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:50.328660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38754d9a-80d0-46ec-8b64-6ddcaf1f251d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:50.344278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 724/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:52.747919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3e56-7c8d-4e9d-a511-6b44a706a2ce None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:52.748820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3e56-7c8d-4e9d-a511-6b44a706a2ce None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:52.748820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be3e56-7c8d-4e9d-a511-6b44a706a2ce None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:52.749882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:51:52.756976 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3625c6-f23f-49a4-b42c-74c19eb6dc84 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:52.757552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3625c6-f23f-49a4-b42c-74c19eb6dc84 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:52.757552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3625c6-f23f-49a4-b42c-74c19eb6dc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:52.777495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3c3625c6-f23f-49a4-b42c-74c19eb6dc84 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:52.778757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3c3625c6-f23f-49a4-b42c-74c19eb6dc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:52.787777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:52.828725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3e56-7c8d-4e9d-a511-6b44a706a2ce None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:52.846955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be3e56-7c8d-4e9d-a511-6b44a706a2ce None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:52.854131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf62ea9-b181-41f1-b27d-24da93346f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:52.855276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf62ea9-b181-41f1-b27d-24da93346f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:52.855787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf62ea9-b181-41f1-b27d-24da93346f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:52.856284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf62ea9-b181-41f1-b27d-24da93346f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:52.873683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf62ea9-b181-41f1-b27d-24da93346f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:52.876682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf62ea9-b181-41f1-b27d-24da93346f63 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:52.896384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 721/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:51:55.585842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f78c7-7d01-478e-966b-78b8753a4168 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:55.586566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f78c7-7d01-478e-966b-78b8753a4168 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:55.586566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f78c7-7d01-478e-966b-78b8753a4168 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:55.588927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:51:55.595558 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c624c-5edc-45b0-9f26-5d02b2761e41 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:55.596375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c624c-5edc-45b0-9f26-5d02b2761e41 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:55.596536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c624c-5edc-45b0-9f26-5d02b2761e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:55.617749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-975c624c-5edc-45b0-9f26-5d02b2761e41 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:55.619003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-975c624c-5edc-45b0-9f26-5d02b2761e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:55.627969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:55.672982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f78c7-7d01-478e-966b-78b8753a4168 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:55.685391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f78c7-7d01-478e-966b-78b8753a4168 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:55.691226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ea55e-f7b1-4b8f-9ebd-fc5534cfb207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:55.692485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ea55e-f7b1-4b8f-9ebd-fc5534cfb207 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:55.693050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ea55e-f7b1-4b8f-9ebd-fc5534cfb207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:55.693606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ea55e-f7b1-4b8f-9ebd-fc5534cfb207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:55.714212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ea55e-f7b1-4b8f-9ebd-fc5534cfb207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:55.715895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ea55e-f7b1-4b8f-9ebd-fc5534cfb207 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:55.726971 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 727/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:51:58.237743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40738dd-c974-4b67-bb76-320990fbb234 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:58.238577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40738dd-c974-4b67-bb76-320990fbb234 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:58.238577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40738dd-c974-4b67-bb76-320990fbb234 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:58.239740 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:51:58.247490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27088189-47fa-437d-b85b-ed8da8fb8e05 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:58.248234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27088189-47fa-437d-b85b-ed8da8fb8e05 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:58.248234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27088189-47fa-437d-b85b-ed8da8fb8e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:58.268291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-27088189-47fa-437d-b85b-ed8da8fb8e05 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:51:58.269769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-27088189-47fa-437d-b85b-ed8da8fb8e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:51:58.279125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:51:58.321374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40738dd-c974-4b67-bb76-320990fbb234 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:51:58.333955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40738dd-c974-4b67-bb76-320990fbb234 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:51:58.338989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa84f14-936c-418f-a8fa-1a39b026c438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:51:58.339694 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84f14-936c-418f-a8fa-1a39b026c438 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:51:58.339984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84f14-936c-418f-a8fa-1a39b026c438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:51:58.340263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84f14-936c-418f-a8fa-1a39b026c438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:51:58.350576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa84f14-936c-418f-a8fa-1a39b026c438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:51:58.352109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa84f14-936c-418f-a8fa-1a39b026c438 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:51:58.365492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 724/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:52:01.088554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa83b3-9bf7-4b98-991b-bea5cfb6ddd6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:01.089194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa83b3-9bf7-4b98-991b-bea5cfb6ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:01.089194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa83b3-9bf7-4b98-991b-bea5cfb6ddd6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:01.091189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:52:01.098256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aba43b-407a-45ad-a117-8fa4be4af9a0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:01.098849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aba43b-407a-45ad-a117-8fa4be4af9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:01.099312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aba43b-407a-45ad-a117-8fa4be4af9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:01.130959 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b6aba43b-407a-45ad-a117-8fa4be4af9a0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:01.133124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b6aba43b-407a-45ad-a117-8fa4be4af9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:01.148381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:01.189862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa83b3-9bf7-4b98-991b-bea5cfb6ddd6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:01.202097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa83b3-9bf7-4b98-991b-bea5cfb6ddd6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:01.206164 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66869a-171e-418b-8b97-992dcadbd4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:01.206838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66869a-171e-418b-8b97-992dcadbd4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:01.207125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66869a-171e-418b-8b97-992dcadbd4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:01.207441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66869a-171e-418b-8b97-992dcadbd4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:01.218935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66869a-171e-418b-8b97-992dcadbd4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:01.220700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66869a-171e-418b-8b97-992dcadbd4b2 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:01.232490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 730/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:52:03.600087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176c7ea-9438-41bc-89ac-6540e706f967 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:03.600674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176c7ea-9438-41bc-89ac-6540e706f967 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:03.600674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176c7ea-9438-41bc-89ac-6540e706f967 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:03.602181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:52:03.611366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5234f8-d70b-469a-852c-dda752666604 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:03.612092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5234f8-d70b-469a-852c-dda752666604 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:03.612456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5234f8-d70b-469a-852c-dda752666604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:03.622773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=70 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:52:03.638942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7e5234f8-d70b-469a-852c-dda752666604 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:03.640530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7e5234f8-d70b-469a-852c-dda752666604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:03.649591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:03.693175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176c7ea-9438-41bc-89ac-6540e706f967 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:03.700053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=64 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:52:03.708574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176c7ea-9438-41bc-89ac-6540e706f967 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:03.713410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795b78-942c-4d80-b06f-6ad4087639ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:03.714105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795b78-942c-4d80-b06f-6ad4087639ef service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:03.714392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795b78-942c-4d80-b06f-6ad4087639ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:03.714677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795b78-942c-4d80-b06f-6ad4087639ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:03.735314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795b78-942c-4d80-b06f-6ad4087639ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:03.736953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795b78-942c-4d80-b06f-6ad4087639ef service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:03.748590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 727/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:52:06.282037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dbd0d-911c-45cc-bafd-66450840461d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:06.282680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dbd0d-911c-45cc-bafd-66450840461d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:06.282680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dbd0d-911c-45cc-bafd-66450840461d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:06.284093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:52:06.290909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb762606-f35d-4119-a875-bb4a8c7084ac None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:06.291871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb762606-f35d-4119-a875-bb4a8c7084ac None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:06.291871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb762606-f35d-4119-a875-bb4a8c7084ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:06.311351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bb762606-f35d-4119-a875-bb4a8c7084ac None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:06.312622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bb762606-f35d-4119-a875-bb4a8c7084ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:06.321648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:06.389265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dbd0d-911c-45cc-bafd-66450840461d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:06.402540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dbd0d-911c-45cc-bafd-66450840461d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:06.406845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e958ff3-6e05-4705-aaab-3941f51cf0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:06.407643 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e958ff3-6e05-4705-aaab-3941f51cf0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:06.407975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e958ff3-6e05-4705-aaab-3941f51cf0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:06.408306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e958ff3-6e05-4705-aaab-3941f51cf0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:06.419707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e958ff3-6e05-4705-aaab-3941f51cf0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:06.421247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e958ff3-6e05-4705-aaab-3941f51cf0d3 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:06.433342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 733/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:52:08.860703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe87c2-221e-4652-8e83-6e9afcd250eb None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:08.861422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe87c2-221e-4652-8e83-6e9afcd250eb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:08.861422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe87c2-221e-4652-8e83-6e9afcd250eb None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:08.862668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:52:08.869933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb212f-4709-4e40-a067-21c66a2c69a3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:08.870579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb212f-4709-4e40-a067-21c66a2c69a3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:08.870579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb212f-4709-4e40-a067-21c66a2c69a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:08.891711 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-92fb212f-4709-4e40-a067-21c66a2c69a3 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:08.892972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-92fb212f-4709-4e40-a067-21c66a2c69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:08.901945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:08.942538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe87c2-221e-4652-8e83-6e9afcd250eb None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:08.954829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe87c2-221e-4652-8e83-6e9afcd250eb None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:08.958642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7fd37-6328-4eb4-8e3c-a859ef732a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:08.959360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7fd37-6328-4eb4-8e3c-a859ef732a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:08.959652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7fd37-6328-4eb4-8e3c-a859ef732a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:08.959939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7fd37-6328-4eb4-8e3c-a859ef732a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:08.971270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7fd37-6328-4eb4-8e3c-a859ef732a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:08.972750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7fd37-6328-4eb4-8e3c-a859ef732a53 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:08.984260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 730/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:52:11.500695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e23aa-f3f9-4dfc-9dc6-4491fcf7664d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:11.501316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e23aa-f3f9-4dfc-9dc6-4491fcf7664d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:11.501702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e23aa-f3f9-4dfc-9dc6-4491fcf7664d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:11.504365 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:52:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:52:11.514270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7b63-0de8-49c2-8f81-3db647cb9cf0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:11.514862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7b63-0de8-49c2-8f81-3db647cb9cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:11.514967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7b63-0de8-49c2-8f81-3db647cb9cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:11.535254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2c8d7b63-0de8-49c2-8f81-3db647cb9cf0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:11.536399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2c8d7b63-0de8-49c2-8f81-3db647cb9cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:11.545194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:11.585103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e23aa-f3f9-4dfc-9dc6-4491fcf7664d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:11.599020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e23aa-f3f9-4dfc-9dc6-4491fcf7664d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:11.604023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55b0f-fb65-478d-9763-e96f1568bc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:11.604717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55b0f-fb65-478d-9763-e96f1568bc4e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:11.605114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55b0f-fb65-478d-9763-e96f1568bc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:11.605410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55b0f-fb65-478d-9763-e96f1568bc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:11.616201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55b0f-fb65-478d-9763-e96f1568bc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:11.618499 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55b0f-fb65-478d-9763-e96f1568bc4e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:11.630341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 736/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:52:13.957079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0a0a7-87cb-41df-8d94-9671516f7b68 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:13.957919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0a0a7-87cb-41df-8d94-9671516f7b68 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:13.957919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0a0a7-87cb-41df-8d94-9671516f7b68 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:13.959206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:52:13.968957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26ac3-bd6e-4c3f-babe-9981513457ae None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:13.969902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26ac3-bd6e-4c3f-babe-9981513457ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:13.970433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26ac3-bd6e-4c3f-babe-9981513457ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:13.999299 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-39e26ac3-bd6e-4c3f-babe-9981513457ae None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:14.000755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-39e26ac3-bd6e-4c3f-babe-9981513457ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:14.013575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:52:14.062235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0a0a7-87cb-41df-8d94-9671516f7b68 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:14.092599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0a0a7-87cb-41df-8d94-9671516f7b68 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:14.098665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a800049-2b5f-4a11-983c-d758dc302ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:14.099843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a800049-2b5f-4a11-983c-d758dc302ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:14.100360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a800049-2b5f-4a11-983c-d758dc302ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:14.100854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a800049-2b5f-4a11-983c-d758dc302ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:14.116431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a800049-2b5f-4a11-983c-d758dc302ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:14.118552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a800049-2b5f-4a11-983c-d758dc302ea4 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:14.135444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 733/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:52:23.990690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=20 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:52:24.124872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=23 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:52:36.414098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443731-a250-4ffb-bcec-fa2c9ad9059e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:36.414742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443731-a250-4ffb-bcec-fa2c9ad9059e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:36.414950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443731-a250-4ffb-bcec-fa2c9ad9059e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:36.416313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 738/1471] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:52:36.422700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21efca9-7539-49c0-a1cd-45fbbef0f161 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:36.423406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21efca9-7539-49c0-a1cd-45fbbef0f161 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:36.423406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21efca9-7539-49c0-a1cd-45fbbef0f161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:36.444208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d21efca9-7539-49c0-a1cd-45fbbef0f161 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:36.446537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d21efca9-7539-49c0-a1cd-45fbbef0f161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:36.465590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 734/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:36.519629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858c6d-d80b-4bd2-9e31-d1527257b5e8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:36.519932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858c6d-d80b-4bd2-9e31-d1527257b5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:36.520475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858c6d-d80b-4bd2-9e31-d1527257b5e8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:36.522360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 739/1473] 10.222.0.46 () {54 vars in 962 bytes} [Tue Jun 21 15:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:52:36.528349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b9453-2ae6-4e74-b546-39aa754c57d1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:36.528787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b9453-2ae6-4e74-b546-39aa754c57d1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:36.529164 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b9453-2ae6-4e74-b546-39aa754c57d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:36.550031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d87b9453-2ae6-4e74-b546-39aa754c57d1 None None] MFA Rules not processed for user `61565364dbac41cfac76195c0be88771`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:36.551495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d87b9453-2ae6-4e74-b546-39aa754c57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:36.560691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 735/1474] 10.222.0.46 () {58 vars in 1059 bytes} [Tue Jun 21 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:52:36.568742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0858c6d-d80b-4bd2-9e31-d1527257b5e8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:36.581098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0858c6d-d80b-4bd2-9e31-d1527257b5e8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:36.584979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52b386-5138-461c-919c-073b825e36d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61565364dbac41cfac76195c0be88771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:36.586589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52b386-5138-461c-919c-073b825e36d8 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:36.587227 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52b386-5138-461c-919c-073b825e36d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:36.587458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52b386-5138-461c-919c-073b825e36d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:36.597909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52b386-5138-461c-919c-073b825e36d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:36.599416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52b386-5138-461c-919c-073b825e36d8 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:36.611595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 740/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:52:38.988989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008768e5-70b5-4203-8106-0314e446465f None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:38.989628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008768e5-70b5-4203-8106-0314e446465f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:38.989628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008768e5-70b5-4203-8106-0314e446465f None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:38.991001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 736/1476] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:52:38.998087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270157b-9ed7-4db0-957a-216f37cc6471 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:38.999001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270157b-9ed7-4db0-957a-216f37cc6471 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:38.999001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270157b-9ed7-4db0-957a-216f37cc6471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:39.020562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3270157b-9ed7-4db0-957a-216f37cc6471 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:39.021990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3270157b-9ed7-4db0-957a-216f37cc6471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:39.031372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 741/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:39.058034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008768e5-70b5-4203-8106-0314e446465f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:39.072971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008768e5-70b5-4203-8106-0314e446465f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:39.078236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e21807-6a86-4f2e-80bf-f2f5e2f45830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:39.078925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e21807-6a86-4f2e-80bf-f2f5e2f45830 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:39.079252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e21807-6a86-4f2e-80bf-f2f5e2f45830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:39.079540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e21807-6a86-4f2e-80bf-f2f5e2f45830 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:39.080327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e21807-6a86-4f2e-80bf-f2f5e2f45830 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:39.082232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: WARNING py.warnings [None req-72e21807-6a86-4f2e-80bf-f2f5e2f45830 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:52:39.082232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: warnings.warn(msg) Jun 21 15:52:39.082232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: Jun 21 15:52:39.083626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e21807-6a86-4f2e-80bf-f2f5e2f45830 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:39.110503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 737/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Tue Jun 21 15:52:39 2022] GET /identity/v3/projects => generated 2553 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:52:41.428781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66903-8bd0-4f7c-b584-ad048572a5a6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:41.430017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66903-8bd0-4f7c-b584-ad048572a5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:41.430017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66903-8bd0-4f7c-b584-ad048572a5a6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:41.431768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 742/1479] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:52:41.441934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dae50-4775-444e-99d0-c587dc77cd6c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:41.442513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dae50-4775-444e-99d0-c587dc77cd6c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:41.442840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dae50-4775-444e-99d0-c587dc77cd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:41.474564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6c2dae50-4775-444e-99d0-c587dc77cd6c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:41.477930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6c2dae50-4775-444e-99d0-c587dc77cd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:41.491595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 738/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:41.569080 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66903-8bd0-4f7c-b584-ad048572a5a6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:41.585384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66903-8bd0-4f7c-b584-ad048572a5a6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:41.591363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649c38f-e1bf-4572-a741-a16b06952d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:41.592235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649c38f-e1bf-4572-a741-a16b06952d8f service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:41.592566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649c38f-e1bf-4572-a741-a16b06952d8f service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:41.592889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649c38f-e1bf-4572-a741-a16b06952d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:41.603090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649c38f-e1bf-4572-a741-a16b06952d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:41.605218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649c38f-e1bf-4572-a741-a16b06952d8f service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:41.616537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 743/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:52:44.129382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735df52-f7f1-4623-a9be-3c24e1b6ff5d None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:44.130016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735df52-f7f1-4623-a9be-3c24e1b6ff5d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:44.130330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735df52-f7f1-4623-a9be-3c24e1b6ff5d None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:44.131923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 739/1482] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:52:44.138790 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14460bd-5445-4f1b-b138-dfc82219635d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:44.139753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14460bd-5445-4f1b-b138-dfc82219635d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:44.139753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14460bd-5445-4f1b-b138-dfc82219635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:44.159835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b14460bd-5445-4f1b-b138-dfc82219635d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:44.161087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b14460bd-5445-4f1b-b138-dfc82219635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:44.170095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 744/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:52:44.233926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735df52-f7f1-4623-a9be-3c24e1b6ff5d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:44.247577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735df52-f7f1-4623-a9be-3c24e1b6ff5d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:44.251547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36d3c5-da59-4340-987b-b7be1a9ddb65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:44.252227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36d3c5-da59-4340-987b-b7be1a9ddb65 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:44.252519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36d3c5-da59-4340-987b-b7be1a9ddb65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:44.252843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36d3c5-da59-4340-987b-b7be1a9ddb65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:44.263837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36d3c5-da59-4340-987b-b7be1a9ddb65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:44.265973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36d3c5-da59-4340-987b-b7be1a9ddb65 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:44.278265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 740/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:52:46.614189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a494-c109-4151-97b2-d396559f6ee7 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:46.614819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a494-c109-4151-97b2-d396559f6ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:46.614819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a494-c109-4151-97b2-d396559f6ee7 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:46.616152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 745/1485] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:52:46.622643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db4934-5eea-45d5-80ea-797825d861f4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:46.623349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db4934-5eea-45d5-80ea-797825d861f4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:46.623349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db4934-5eea-45d5-80ea-797825d861f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:46.644422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-27db4934-5eea-45d5-80ea-797825d861f4 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:46.644960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-27db4934-5eea-45d5-80ea-797825d861f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:46.655529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 741/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:46.699949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716a494-c109-4151-97b2-d396559f6ee7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:46.719568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716a494-c109-4151-97b2-d396559f6ee7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:46.725942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32036d7-992b-4441-a2c9-63b5b1ddbd54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:46.727490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32036d7-992b-4441-a2c9-63b5b1ddbd54 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:46.727882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32036d7-992b-4441-a2c9-63b5b1ddbd54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:46.728225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32036d7-992b-4441-a2c9-63b5b1ddbd54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:46.739268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32036d7-992b-4441-a2c9-63b5b1ddbd54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:46.740785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32036d7-992b-4441-a2c9-63b5b1ddbd54 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:46.757861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 746/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:52:49.088793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205cf8-3134-4923-a29d-f143d50e6044 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:49.089423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205cf8-3134-4923-a29d-f143d50e6044 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:49.089423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205cf8-3134-4923-a29d-f143d50e6044 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:49.090785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 742/1488] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:52:49.099198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a97a76-5d74-4118-95e0-974181e3f400 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:49.099782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a97a76-5d74-4118-95e0-974181e3f400 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:49.099897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a97a76-5d74-4118-95e0-974181e3f400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:49.120538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d5a97a76-5d74-4118-95e0-974181e3f400 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:49.121797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d5a97a76-5d74-4118-95e0-974181e3f400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:49.130197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 747/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:49.173375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7205cf8-3134-4923-a29d-f143d50e6044 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:49.188373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7205cf8-3134-4923-a29d-f143d50e6044 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:49.195597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027161b-7d5a-4f6a-b2f0-000743114c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:49.196782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027161b-7d5a-4f6a-b2f0-000743114c02 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:49.197345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027161b-7d5a-4f6a-b2f0-000743114c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:49.197881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027161b-7d5a-4f6a-b2f0-000743114c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:49.216683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027161b-7d5a-4f6a-b2f0-000743114c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:49.219597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027161b-7d5a-4f6a-b2f0-000743114c02 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:49.239674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 743/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:52:51.835502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4c465-caa1-4118-9a07-efcd92db8343 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:51.836422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4c465-caa1-4118-9a07-efcd92db8343 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:51.836422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4c465-caa1-4118-9a07-efcd92db8343 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:51.838369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 748/1491] 10.222.0.46 () {54 vars in 926 bytes} [Tue Jun 21 15:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:52:51.844984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cc585-5738-4f38-b231-742abec173e5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:51.845673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cc585-5738-4f38-b231-742abec173e5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:51.845673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cc585-5738-4f38-b231-742abec173e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:51.865142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-806cc585-5738-4f38-b231-742abec173e5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:52:51.866970 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-806cc585-5738-4f38-b231-742abec173e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:52:51.875881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 744/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Tue Jun 21 15:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:52:51.918526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4c465-caa1-4118-9a07-efcd92db8343 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:52:51.931202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4c465-caa1-4118-9a07-efcd92db8343 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:52:51.935074 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e8fb5-1926-478a-89ff-3787fdba8229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:52:51.935780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8fb5-1926-478a-89ff-3787fdba8229 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:52:51.936057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8fb5-1926-478a-89ff-3787fdba8229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:52:51.936332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8fb5-1926-478a-89ff-3787fdba8229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:52:51.948277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e8fb5-1926-478a-89ff-3787fdba8229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:52:51.949748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e8fb5-1926-478a-89ff-3787fdba8229 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:52:51.961303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 749/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:53:01.859390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=33 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:53:01.955864 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=33 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:34.378423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f744f-946e-41ba-89da-5f083f8579fe None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:34.379114 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f744f-946e-41ba-89da-5f083f8579fe None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:34.379305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f744f-946e-41ba-89da-5f083f8579fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:34.401251 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b51f744f-946e-41ba-89da-5f083f8579fe None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:54:34.402738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b51f744f-946e-41ba-89da-5f083f8579fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:54:34.412568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 745/1494] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:54:34.422560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a757021-5fb3-46ec-9662-9852ba3600ad None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:34.423199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a757021-5fb3-46ec-9662-9852ba3600ad None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:34.423342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a757021-5fb3-46ec-9662-9852ba3600ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:34.460019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9a757021-5fb3-46ec-9662-9852ba3600ad None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:54:34.461950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9a757021-5fb3-46ec-9662-9852ba3600ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:54:34.476190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 750/1495] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:54:34.482435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f744f-946e-41ba-89da-5f083f8579fe None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:54:34.493141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f744f-946e-41ba-89da-5f083f8579fe None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:54:34.498011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d42a0-7994-4f8b-8084-7b72f2f70529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:54:34.498681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d42a0-7994-4f8b-8084-7b72f2f70529 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:34.498969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d42a0-7994-4f8b-8084-7b72f2f70529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:34.499283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d42a0-7994-4f8b-8084-7b72f2f70529 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:34.500032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d42a0-7994-4f8b-8084-7b72f2f70529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:54:34.500348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d42a0-7994-4f8b-8084-7b72f2f70529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:54:34.501399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: WARNING py.warnings [None req-320d42a0-7994-4f8b-8084-7b72f2f70529 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:54:34.501399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: warnings.warn(msg) Jun 21 15:54:34.501399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: Jun 21 15:54:34.502308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d42a0-7994-4f8b-8084-7b72f2f70529 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:54:34.517671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 746/1496] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:54:34.526713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a757021-5fb3-46ec-9662-9852ba3600ad None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:54:34.537910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a757021-5fb3-46ec-9662-9852ba3600ad None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:54:34.543261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e253d-2169-4b96-8296-e607cadd379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:54:34.543950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e253d-2169-4b96-8296-e607cadd379e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:34.544241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e253d-2169-4b96-8296-e607cadd379e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:34.544513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e253d-2169-4b96-8296-e607cadd379e admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:34.545233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e253d-2169-4b96-8296-e607cadd379e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:54:34.547117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-e34e253d-2169-4b96-8296-e607cadd379e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:54:34.547117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: warnings.warn(msg) Jun 21 15:54:34.547117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: Jun 21 15:54:34.548392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e253d-2169-4b96-8296-e607cadd379e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:54:34.593778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 751/1497] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:54:34 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:54:34.598815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d42a0-7994-4f8b-8084-7b72f2f70529 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:54:34.610122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d42a0-7994-4f8b-8084-7b72f2f70529 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:54:34.683336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eca9a-e313-4890-9932-e671ef9c7b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:54:34.684174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eca9a-e313-4890-9932-e671ef9c7b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:34.684589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eca9a-e313-4890-9932-e671ef9c7b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:34.685002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eca9a-e313-4890-9932-e671ef9c7b8c admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:34.685774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557eca9a-e313-4890-9932-e671ef9c7b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:54:34.686969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: WARNING py.warnings [None req-557eca9a-e313-4890-9932-e671ef9c7b8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:54:34.686969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: warnings.warn(msg) Jun 21 15:54:34.686969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: Jun 21 15:54:34.688476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557eca9a-e313-4890-9932-e671ef9c7b8c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:54:34.716069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 747/1498] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:54:34 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:54:34.721070 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e253d-2169-4b96-8296-e607cadd379e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:54:34.733137 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e253d-2169-4b96-8296-e607cadd379e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:54:34.738516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018921c7-60ae-46c7-907c-9d73cda82192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:54:34.739253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018921c7-60ae-46c7-907c-9d73cda82192 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:34.739546 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018921c7-60ae-46c7-907c-9d73cda82192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:34.739827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018921c7-60ae-46c7-907c-9d73cda82192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:34.740592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018921c7-60ae-46c7-907c-9d73cda82192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:54:34.741673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-018921c7-60ae-46c7-907c-9d73cda82192 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:54:34.741673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: warnings.warn(msg) Jun 21 15:54:34.741673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: Jun 21 15:54:34.742602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018921c7-60ae-46c7-907c-9d73cda82192 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:54:34.758463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 752/1499] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:54:34.763440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eca9a-e313-4890-9932-e671ef9c7b8c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:54:34.775957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eca9a-e313-4890-9932-e671ef9c7b8c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:54:34.781565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1687ea-97d8-4e8d-8c8e-daa6f5378b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:54:34.782399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1687ea-97d8-4e8d-8c8e-daa6f5378b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:34.782765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1687ea-97d8-4e8d-8c8e-daa6f5378b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:34.783287 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1687ea-97d8-4e8d-8c8e-daa6f5378b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:34.784131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1687ea-97d8-4e8d-8c8e-daa6f5378b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:54:34.785689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: WARNING py.warnings [None req-1a1687ea-97d8-4e8d-8c8e-daa6f5378b0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:54:34.785689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: warnings.warn(msg) Jun 21 15:54:34.785689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: Jun 21 15:54:34.787053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1687ea-97d8-4e8d-8c8e-daa6f5378b0f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:54:34.808048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 748/1500] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:54:34.813034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018921c7-60ae-46c7-907c-9d73cda82192 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:54:34.831625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018921c7-60ae-46c7-907c-9d73cda82192 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:54:34.840116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56803187-a2ae-4067-9261-265f8097a1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:54:34.841679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56803187-a2ae-4067-9261-265f8097a1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:34.842143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56803187-a2ae-4067-9261-265f8097a1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:34.842581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56803187-a2ae-4067-9261-265f8097a1b9 admin admin] PATH_INFO: `/v3/projects/3b1dd232dc2f49d0ba31d9e386aebd5f/users/f3937a565b8a4d79ae600df7d4c90f19/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:34.869267 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56803187-a2ae-4067-9261-265f8097a1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1dd232dc2f49d0ba31d9e386aebd5f, user_id=f3937a565b8a4d79ae600df7d4c90f19, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:54:34.870414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-56803187-a2ae-4067-9261-265f8097a1b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:54:34.870414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: warnings.warn(msg) Jun 21 15:54:34.870414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: Jun 21 15:54:34.872457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56803187-a2ae-4067-9261-265f8097a1b9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:54:34.888189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 753/1501] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:54:34 2022] PUT /identity/v3/projects/3b1dd232dc2f49d0ba31d9e386aebd5f/users/f3937a565b8a4d79ae600df7d4c90f19/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:54:34.901944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a3f49-982e-4810-9273-4b63de439e31 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:34.902326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a3f49-982e-4810-9273-4b63de439e31 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:34.902588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a3f49-982e-4810-9273-4b63de439e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:34.934476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-107a3f49-982e-4810-9273-4b63de439e31 None None] MFA Rules not processed for user `f3937a565b8a4d79ae600df7d4c90f19`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:54:34.935549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-107a3f49-982e-4810-9273-4b63de439e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:54:35.012511 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 749/1502] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:54:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:54:35.030948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46168695-66b2-42b1-8bf9-71c6149cdb9f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:35.031290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46168695-66b2-42b1-8bf9-71c6149cdb9f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:35.031698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46168695-66b2-42b1-8bf9-71c6149cdb9f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:35.033340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 754/1503] 10.222.0.46 () {54 vars in 963 bytes} [Tue Jun 21 15:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:54:35.040572 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90356001-83d9-43a2-9a75-6385f539f57e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:35.040922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90356001-83d9-43a2-9a75-6385f539f57e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:35.041255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90356001-83d9-43a2-9a75-6385f539f57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:35.061917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-90356001-83d9-43a2-9a75-6385f539f57e None None] MFA Rules not processed for user `6087f9fd3f814573a243f983faf0ce5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:54:35.063653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-90356001-83d9-43a2-9a75-6385f539f57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:54:35.128710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:35.142142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 750/1504] 10.222.0.46 () {58 vars in 1060 bytes} [Tue Jun 21 15:54:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:54:35.151216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46168695-66b2-42b1-8bf9-71c6149cdb9f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:54:35.164418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46168695-66b2-42b1-8bf9-71c6149cdb9f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:54:35.170959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547b37c-b694-4a3e-b530-32ae2cf34214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:54:35.172106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547b37c-b694-4a3e-b530-32ae2cf34214 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:35.172662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547b37c-b694-4a3e-b530-32ae2cf34214 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:35.173161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547b37c-b694-4a3e-b530-32ae2cf34214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:35.198631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547b37c-b694-4a3e-b530-32ae2cf34214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:54:35.198631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547b37c-b694-4a3e-b530-32ae2cf34214 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:54:35.213752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 755/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:54:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:54:35.266787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04378e0-35f1-4d49-95ed-ac9f6e861757 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:35.267087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04378e0-35f1-4d49-95ed-ac9f6e861757 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:35.267414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04378e0-35f1-4d49-95ed-ac9f6e861757 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:35.268817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 751/1506] 10.222.0.46 () {52 vars in 829 bytes} [Tue Jun 21 15:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:54:35.274110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547b37c-b694-4a3e-b530-32ae2cf34214 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:54:35.353661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547b37c-b694-4a3e-b530-32ae2cf34214 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:54:35.358791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:54:35.360117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:35.360593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:35.361021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] PATH_INFO: `/v3/users/f3937a565b8a4d79ae600df7d4c90f19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:35.362544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3937a565b8a4d79ae600df7d4c90f19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:54:35.364507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:54:35.364507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: warnings.warn(msg) Jun 21 15:54:35.364507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: Jun 21 15:54:35.366533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:54:35.462016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3937a565b8a4d79ae600df7d4c90f19'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:54:35.499623 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3937a565b8a4d79ae600df7d4c90f19'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:54:35.517081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3937a565b8a4d79ae600df7d4c90f19'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:54:35.518071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3937a565b8a4d79ae600df7d4c90f19'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:54:35.534130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:35.542506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3937a565b8a4d79ae600df7d4c90f19'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:54:35.554975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 756/1507] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:54:35 2022] DELETE /identity/v3/users/f3937a565b8a4d79ae600df7d4c90f19 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:54:35.560041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf0281-22f8-4923-8443-91665e75b949 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:35.560663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf0281-22f8-4923-8443-91665e75b949 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:35.560663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf0281-22f8-4923-8443-91665e75b949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:35.580915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0eaf0281-22f8-4923-8443-91665e75b949 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:54:35.583562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0eaf0281-22f8-4923-8443-91665e75b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:54:35.657683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 752/1508] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:54:35.669001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:54:35.670589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:54:35.744636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e817aff-ee62-44f5-b9e1-0b0c7171fc88 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:54:35.748450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cf4ef-5d7d-43eb-a5a4-3c421db38995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:54:35.749134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cf4ef-5d7d-43eb-a5a4-3c421db38995 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:35.749422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cf4ef-5d7d-43eb-a5a4-3c421db38995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:35.749704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cf4ef-5d7d-43eb-a5a4-3c421db38995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:35.761148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cf4ef-5d7d-43eb-a5a4-3c421db38995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:54:35.762633 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cf4ef-5d7d-43eb-a5a4-3c421db38995 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:54:35.778715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 757/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:54:36.201391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf0281-22f8-4923-8443-91665e75b949 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:54:36.203493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0eaf0281-22f8-4923-8443-91665e75b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:54:36.226084 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf0281-22f8-4923-8443-91665e75b949 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:54:36.233986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:54:36.234956 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:54:36.235290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:54:36.235572 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] PATH_INFO: `/v3/projects/3b1dd232dc2f49d0ba31d9e386aebd5f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:54:36.236964 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1dd232dc2f49d0ba31d9e386aebd5f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:54:36.238181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: WARNING py.warnings [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:54:36.238181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: warnings.warn(msg) Jun 21 15:54:36.238181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: Jun 21 15:54:36.240261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:54:36.335889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1dd232dc2f49d0ba31d9e386aebd5f', 'request_id': 'req-8538d800-1e42-4351-837d-84eed130497c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:54:36.343090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1dd232dc2f49d0ba31d9e386aebd5f', 'request_id': 'req-8538d800-1e42-4351-837d-84eed130497c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:54:36.356365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1dd232dc2f49d0ba31d9e386aebd5f', 'request_id': 'req-8538d800-1e42-4351-837d-84eed130497c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:54:36.383197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] The token cache is being invalidate because project 3b1dd232dc2f49d0ba31d9e386aebd5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:54:36.383599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:54:36.384408 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8538d800-1e42-4351-837d-84eed130497c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:54:36.386211 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 753/1510] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:54:36 2022] DELETE /identity/v3/projects/3b1dd232dc2f49d0ba31d9e386aebd5f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:54:45.769302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=29 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:54:46.378170 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:34.706189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53139f-fb35-4f5e-9c50-7ce2a614bd89 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:34.706978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53139f-fb35-4f5e-9c50-7ce2a614bd89 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:34.706978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53139f-fb35-4f5e-9c50-7ce2a614bd89 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:34.708224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:56:34.713954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e44099-04ef-4007-b420-fa563214f125 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:34.714557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e44099-04ef-4007-b420-fa563214f125 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:34.714557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e44099-04ef-4007-b420-fa563214f125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:34.736016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-11e44099-04ef-4007-b420-fa563214f125 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:56:34.737560 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-11e44099-04ef-4007-b420-fa563214f125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:56:34.813500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:56:34.979877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53139f-fb35-4f5e-9c50-7ce2a614bd89 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:56:34.982012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9c53139f-fb35-4f5e-9c50-7ce2a614bd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:56:35.070928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53139f-fb35-4f5e-9c50-7ce2a614bd89 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:56:35.076765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfc1f0-03f0-4162-8f79-45a63d5f17f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:56:35.077507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfc1f0-03f0-4162-8f79-45a63d5f17f0 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:35.078395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfc1f0-03f0-4162-8f79-45a63d5f17f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:35.078664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfc1f0-03f0-4162-8f79-45a63d5f17f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:35.089127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfc1f0-03f0-4162-8f79-45a63d5f17f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:56:35.090806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfc1f0-03f0-4162-8f79-45a63d5f17f0 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:56:35.103086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 759/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:56:36.029159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb2b1-67f8-4fbf-a1de-ad32ec46e007 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:36.029808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb2b1-67f8-4fbf-a1de-ad32ec46e007 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:36.029808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb2b1-67f8-4fbf-a1de-ad32ec46e007 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:36.031892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:56:36.038127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbb59c-16f7-44fb-a182-394e06d5921f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:36.038733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbb59c-16f7-44fb-a182-394e06d5921f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:36.038733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbb59c-16f7-44fb-a182-394e06d5921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:36.060569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cfbbb59c-16f7-44fb-a182-394e06d5921f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:56:36.061839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cfbbb59c-16f7-44fb-a182-394e06d5921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:56:36.072016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:56:36.229814 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bb2b1-67f8-4fbf-a1de-ad32ec46e007 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:56:36.246078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bb2b1-67f8-4fbf-a1de-ad32ec46e007 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:56:36.256715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f757a-5e01-423d-b54d-97ecdeb1f320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:56:36.257410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f757a-5e01-423d-b54d-97ecdeb1f320 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:36.257695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f757a-5e01-423d-b54d-97ecdeb1f320 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:36.258986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f757a-5e01-423d-b54d-97ecdeb1f320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:36.273459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f757a-5e01-423d-b54d-97ecdeb1f320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:56:36.275280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f757a-5e01-423d-b54d-97ecdeb1f320 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:56:36.294329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 756/1516] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:56:38.610929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baa5fc-371c-4d31-a7df-fd1c2bbcf3a4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:38.611823 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baa5fc-371c-4d31-a7df-fd1c2bbcf3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:38.611823 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baa5fc-371c-4d31-a7df-fd1c2bbcf3a4 None None] PATH_INFO: `/v3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:38.613381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 761/1517] 10.222.0.99 () {54 vars in 925 bytes} [Tue Jun 21 15:56:38 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:56:38.625439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54438b-57f6-47cc-92e8-e03b851cab9f None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:38.626175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54438b-57f6-47cc-92e8-e03b851cab9f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:38.626175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54438b-57f6-47cc-92e8-e03b851cab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:38.648350 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2f54438b-57f6-47cc-92e8-e03b851cab9f None None] MFA Rules not processed for user `2d1aeacb83a142db99823f29bd1b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:56:38.649943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2f54438b-57f6-47cc-92e8-e03b851cab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:56:38.735329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 757/1518] 10.222.0.99 () {58 vars in 1015 bytes} [Tue Jun 21 15:56:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:56:46.054318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=37 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:56:47.685173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db0efd-b304-45c1-bcf0-3a8d33adb0c6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:47.685891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db0efd-b304-45c1-bcf0-3a8d33adb0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:47.685891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db0efd-b304-45c1-bcf0-3a8d33adb0c6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:47.687764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 762/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:56:47.694531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732068-b2cc-4e7a-b25e-1e2d037056b0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:47.695108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732068-b2cc-4e7a-b25e-1e2d037056b0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:47.695402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732068-b2cc-4e7a-b25e-1e2d037056b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:47.721807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a5732068-b2cc-4e7a-b25e-1e2d037056b0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:56:47.723053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a5732068-b2cc-4e7a-b25e-1e2d037056b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:56:47.732327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 758/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:56:48.035460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db0efd-b304-45c1-bcf0-3a8d33adb0c6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:56:48.059303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db0efd-b304-45c1-bcf0-3a8d33adb0c6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:56:48.065831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bd235-8cff-4047-bcdc-9c205cddfdf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:56:48.066515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bd235-8cff-4047-bcdc-9c205cddfdf5 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:48.066810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bd235-8cff-4047-bcdc-9c205cddfdf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:48.067093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bd235-8cff-4047-bcdc-9c205cddfdf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:48.077125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bd235-8cff-4047-bcdc-9c205cddfdf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:56:48.080355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bd235-8cff-4047-bcdc-9c205cddfdf5 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:56:48.092270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 763/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:56:49.100367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8aeed-b03c-4569-852b-ca15bfde51a4 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:49.100999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8aeed-b03c-4569-852b-ca15bfde51a4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:49.100999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8aeed-b03c-4569-852b-ca15bfde51a4 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:49.102370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:56:49.108041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba990-385f-4a1a-97da-376b67f8f962 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:49.109662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba990-385f-4a1a-97da-376b67f8f962 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:49.109662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba990-385f-4a1a-97da-376b67f8f962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:49.132908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-101ba990-385f-4a1a-97da-376b67f8f962 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:56:49.134180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-101ba990-385f-4a1a-97da-376b67f8f962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:56:49.143048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:56:49.442760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8aeed-b03c-4569-852b-ca15bfde51a4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:56:49.470370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8aeed-b03c-4569-852b-ca15bfde51a4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:56:49.479613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919abdb4-6653-4614-9bb5-27597507ef85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:56:49.480745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919abdb4-6653-4614-9bb5-27597507ef85 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:49.481270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919abdb4-6653-4614-9bb5-27597507ef85 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:49.481808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919abdb4-6653-4614-9bb5-27597507ef85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:49.498502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919abdb4-6653-4614-9bb5-27597507ef85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:56:49.502165 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919abdb4-6653-4614-9bb5-27597507ef85 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:56:49.522816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 760/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:56:50.894592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadec0e-b070-4cb3-811a-34a7806f1567 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:50.895230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadec0e-b070-4cb3-811a-34a7806f1567 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:50.895230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadec0e-b070-4cb3-811a-34a7806f1567 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:50.896735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 765/1525] 10.222.0.46 () {54 vars in 960 bytes} [Tue Jun 21 15:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:56:50.903908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a072c60-d119-440b-9192-afa4e0f58bff None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:50.904764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a072c60-d119-440b-9192-afa4e0f58bff None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:50.904926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a072c60-d119-440b-9192-afa4e0f58bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:50.932725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2a072c60-d119-440b-9192-afa4e0f58bff None None] MFA Rules not processed for user `2d1aeacb83a142db99823f29bd1b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:56:50.934204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2a072c60-d119-440b-9192-afa4e0f58bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:56:50.944798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 761/1526] 10.222.0.46 () {58 vars in 1057 bytes} [Tue Jun 21 15:56:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:56:50.953043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadec0e-b070-4cb3-811a-34a7806f1567 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:56:50.970574 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadec0e-b070-4cb3-811a-34a7806f1567 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:56:50.976446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c392d5-f44e-4ce5-8b8f-9164ef71a443 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:56:50.977203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c392d5-f44e-4ce5-8b8f-9164ef71a443 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:56:50.977496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c392d5-f44e-4ce5-8b8f-9164ef71a443 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:56:50.977779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c392d5-f44e-4ce5-8b8f-9164ef71a443 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:56:50.988859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c392d5-f44e-4ce5-8b8f-9164ef71a443 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:56:50.990551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c392d5-f44e-4ce5-8b8f-9164ef71a443 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:56:51.004306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 766/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:56:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:57:00.906611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2bf88-285b-4333-94ca-ff24f541ca18 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:00.907294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2bf88-285b-4333-94ca-ff24f541ca18 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:00.907415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2bf88-285b-4333-94ca-ff24f541ca18 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:00.909287 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:57:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:57:00.915493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8728c0-c63e-47a7-9757-b5b32ca8731c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:00.916355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8728c0-c63e-47a7-9757-b5b32ca8731c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:00.916530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8728c0-c63e-47a7-9757-b5b32ca8731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:00.925133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=74 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:00.939390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ef8728c0-c63e-47a7-9757-b5b32ca8731c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:57:00.940661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ef8728c0-c63e-47a7-9757-b5b32ca8731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:57:00.948882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:57:01.117515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2bf88-285b-4333-94ca-ff24f541ca18 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:57:01.136144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2bf88-285b-4333-94ca-ff24f541ca18 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:57:01.145657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c49b37-f289-495f-8352-3ec6f23cb979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:57:01.146464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c49b37-f289-495f-8352-3ec6f23cb979 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:01.146870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c49b37-f289-495f-8352-3ec6f23cb979 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:01.147374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c49b37-f289-495f-8352-3ec6f23cb979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:01.159122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c49b37-f289-495f-8352-3ec6f23cb979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:57:01.160709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c49b37-f289-495f-8352-3ec6f23cb979 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:57:01.173265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 763/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:57:02.361204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632894c6-defe-401d-90ce-e9b24a63e7f6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:02.361784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632894c6-defe-401d-90ce-e9b24a63e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:02.361784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632894c6-defe-401d-90ce-e9b24a63e7f6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:02.363141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:57:02.373057 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5306a3e-cc4b-4c31-8b8a-750cb928f58b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:02.373827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5306a3e-cc4b-4c31-8b8a-750cb928f58b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:02.375144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5306a3e-cc4b-4c31-8b8a-750cb928f58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:02.403110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c5306a3e-cc4b-4c31-8b8a-750cb928f58b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:57:02.405028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c5306a3e-cc4b-4c31-8b8a-750cb928f58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:57:02.413717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:57:02.570025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632894c6-defe-401d-90ce-e9b24a63e7f6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:57:02.595488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632894c6-defe-401d-90ce-e9b24a63e7f6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:57:02.604872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4886011-de9c-4675-ad66-cfc1d81f3541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:57:02.606017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4886011-de9c-4675-ad66-cfc1d81f3541 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:02.606528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4886011-de9c-4675-ad66-cfc1d81f3541 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:02.607037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4886011-de9c-4675-ad66-cfc1d81f3541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:02.623727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4886011-de9c-4675-ad66-cfc1d81f3541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:57:02.626817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4886011-de9c-4675-ad66-cfc1d81f3541 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:57:02.645200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 769/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:57:07.671463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926c3b1-f08f-49a3-8c54-2f2163a62817 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:07.672111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926c3b1-f08f-49a3-8c54-2f2163a62817 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:07.672311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926c3b1-f08f-49a3-8c54-2f2163a62817 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:07.673699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:57:07.680305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786324a-7bf3-437e-9b8b-061a08794f96 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:07.680999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786324a-7bf3-437e-9b8b-061a08794f96 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:07.680999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786324a-7bf3-437e-9b8b-061a08794f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:07.704496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7786324a-7bf3-437e-9b8b-061a08794f96 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:57:07.705808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7786324a-7bf3-437e-9b8b-061a08794f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:57:07.715781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:57:07.755753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926c3b1-f08f-49a3-8c54-2f2163a62817 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:57:07.757602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8926c3b1-f08f-49a3-8c54-2f2163a62817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:57:07.837267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926c3b1-f08f-49a3-8c54-2f2163a62817 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:57:07.842069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5608c-4f99-498e-bc0e-4cf102b46bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:57:07.843469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5608c-4f99-498e-bc0e-4cf102b46bdc service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:07.843965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5608c-4f99-498e-bc0e-4cf102b46bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:07.844361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5608c-4f99-498e-bc0e-4cf102b46bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:07.855870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5608c-4f99-498e-bc0e-4cf102b46bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:57:07.857530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5608c-4f99-498e-bc0e-4cf102b46bdc service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:57:07.870141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 766/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:57:10.195652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2d685-83b9-4a34-b9f5-2bdb06712f4a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:10.196221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2d685-83b9-4a34-b9f5-2bdb06712f4a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:10.196221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2d685-83b9-4a34-b9f5-2bdb06712f4a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:10.197882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:57:10.206413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9055ab-34d6-466c-861c-84330c13be1c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:10.207026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9055ab-34d6-466c-861c-84330c13be1c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:10.207026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9055ab-34d6-466c-861c-84330c13be1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:10.227982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2c9055ab-34d6-466c-861c-84330c13be1c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:57:10.229234 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2c9055ab-34d6-466c-861c-84330c13be1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:57:10.238556 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:57:10.276421 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2d685-83b9-4a34-b9f5-2bdb06712f4a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:57:10.289260 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2d685-83b9-4a34-b9f5-2bdb06712f4a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:57:10.293106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4d50-556e-4cbf-843d-040837d3d753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:57:10.293766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4d50-556e-4cbf-843d-040837d3d753 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:10.294050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4d50-556e-4cbf-843d-040837d3d753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:10.294327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4d50-556e-4cbf-843d-040837d3d753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:10.305879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4d50-556e-4cbf-843d-040837d3d753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:57:10.307382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4d50-556e-4cbf-843d-040837d3d753 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:57:10.318839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 772/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:57:14.345669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004b82b-bb4a-4296-ae01-a4d15950b6bd None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:14.346216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004b82b-bb4a-4296-ae01-a4d15950b6bd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:14.346216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004b82b-bb4a-4296-ae01-a4d15950b6bd None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:14.348104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 768/1540] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:57:14.354254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910e4a9-03c9-40d9-afce-d24413ddcc32 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:14.355181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910e4a9-03c9-40d9-afce-d24413ddcc32 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:14.355368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910e4a9-03c9-40d9-afce-d24413ddcc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:14.376102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8910e4a9-03c9-40d9-afce-d24413ddcc32 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:57:14.377374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8910e4a9-03c9-40d9-afce-d24413ddcc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:57:14.386070 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 773/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:57:14.768924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004b82b-bb4a-4296-ae01-a4d15950b6bd None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:57:14.770935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2004b82b-bb4a-4296-ae01-a4d15950b6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:57:14.840504 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004b82b-bb4a-4296-ae01-a4d15950b6bd None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:57:14.845205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b12b62-9b4f-46e1-8ab4-d6c4acb40320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:57:14.845880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b12b62-9b4f-46e1-8ab4-d6c4acb40320 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:14.846168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b12b62-9b4f-46e1-8ab4-d6c4acb40320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:14.846449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b12b62-9b4f-46e1-8ab4-d6c4acb40320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:14.856563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b12b62-9b4f-46e1-8ab4-d6c4acb40320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:57:14.859357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b12b62-9b4f-46e1-8ab4-d6c4acb40320 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:57:14.870750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 769/1542] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:57:17.122103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bb55b-40ad-466c-8cb3-131c3997ba43 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:17.122745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bb55b-40ad-466c-8cb3-131c3997ba43 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:17.122745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bb55b-40ad-466c-8cb3-131c3997ba43 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:17.124999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 774/1543] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:57:17.131731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a6e1a-4fe4-4766-a52a-d9d844b104c5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:17.132378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a6e1a-4fe4-4766-a52a-d9d844b104c5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:17.132378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a6e1a-4fe4-4766-a52a-d9d844b104c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:17.153838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e92a6e1a-4fe4-4766-a52a-d9d844b104c5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:57:17.155895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e92a6e1a-4fe4-4766-a52a-d9d844b104c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:57:17.164755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 770/1544] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:57:17.485136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bb55b-40ad-466c-8cb3-131c3997ba43 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:57:17.486926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-460bb55b-40ad-466c-8cb3-131c3997ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:57:17.495796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=37 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:17.504548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bb55b-40ad-466c-8cb3-131c3997ba43 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:57:17.509006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4530ee-819e-4334-b8ef-afaaa7b2c4a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:57:17.509782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4530ee-819e-4334-b8ef-afaaa7b2c4a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:57:17.510120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4530ee-819e-4334-b8ef-afaaa7b2c4a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:57:17.510455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4530ee-819e-4334-b8ef-afaaa7b2c4a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:57:17.522696 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4530ee-819e-4334-b8ef-afaaa7b2c4a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:57:17.524255 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4530ee-819e-4334-b8ef-afaaa7b2c4a8 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:57:17.536543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 775/1545] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:57:27.147219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=67 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:57:27.531016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:05.581576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d15a-3600-49ff-a14c-4ac1ce8bb606 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:05.590631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d15a-3600-49ff-a14c-4ac1ce8bb606 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:05.590631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d15a-3600-49ff-a14c-4ac1ce8bb606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:05.616053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-32d0d15a-3600-49ff-a14c-4ac1ce8bb606 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:05.617307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-32d0d15a-3600-49ff-a14c-4ac1ce8bb606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:05.630077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 771/1546] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 21 15:59:05.641822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d538d-4d04-4042-9471-a541245df4ae None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:05.642724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d538d-4d04-4042-9471-a541245df4ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:05.642724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d538d-4d04-4042-9471-a541245df4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:05.675520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e49d538d-4d04-4042-9471-a541245df4ae None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:05.676976 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e49d538d-4d04-4042-9471-a541245df4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:05.689375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 776/1547] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:59:05.693873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d15a-3600-49ff-a14c-4ac1ce8bb606 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:05.710052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d15a-3600-49ff-a14c-4ac1ce8bb606 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:05.724325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa56ba-fdb2-4f6d-bdab-50687967c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:05.725196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa56ba-fdb2-4f6d-bdab-50687967c6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:05.725494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa56ba-fdb2-4f6d-bdab-50687967c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:05.725775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa56ba-fdb2-4f6d-bdab-50687967c6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:05.726529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa56ba-fdb2-4f6d-bdab-50687967c6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:05.726841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa56ba-fdb2-4f6d-bdab-50687967c6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:05.729034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa56ba-fdb2-4f6d-bdab-50687967c6d6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:05.748423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 772/1548] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:05.756719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d538d-4d04-4042-9471-a541245df4ae None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:05.772218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d538d-4d04-4042-9471-a541245df4ae None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:05.784958 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43fe70-c37b-43db-8284-d6e0450b40c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:05.785656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43fe70-c37b-43db-8284-d6e0450b40c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:05.785948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43fe70-c37b-43db-8284-d6e0450b40c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:05.786233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43fe70-c37b-43db-8284-d6e0450b40c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:05.787789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43fe70-c37b-43db-8284-d6e0450b40c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:05.789888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43fe70-c37b-43db-8284-d6e0450b40c4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:05.842030 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 777/1549] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:05 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:05.845903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa56ba-fdb2-4f6d-bdab-50687967c6d6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:05.860412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa56ba-fdb2-4f6d-bdab-50687967c6d6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:05.967754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5db7a-f67e-4e43-bfd9-1c2dcf66b87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:05.968475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5db7a-f67e-4e43-bfd9-1c2dcf66b87e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:05.968934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5db7a-f67e-4e43-bfd9-1c2dcf66b87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:05.969227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5db7a-f67e-4e43-bfd9-1c2dcf66b87e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:05.969965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5db7a-f67e-4e43-bfd9-1c2dcf66b87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:05.972022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5db7a-f67e-4e43-bfd9-1c2dcf66b87e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:06.019004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 773/1550] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:05 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:06.020188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202bfda-58fb-429f-9c5f-e5f88002e366 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.020682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202bfda-58fb-429f-9c5f-e5f88002e366 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.020983 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202bfda-58fb-429f-9c5f-e5f88002e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.023636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5db7a-f67e-4e43-bfd9-1c2dcf66b87e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:06.036936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5db7a-f67e-4e43-bfd9-1c2dcf66b87e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:06.052383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094f355-bdcf-4ebd-b3d0-597599e24c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:06.053100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f355-bdcf-4ebd-b3d0-597599e24c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.053390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f355-bdcf-4ebd-b3d0-597599e24c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.053674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f355-bdcf-4ebd-b3d0-597599e24c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.054441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094f355-bdcf-4ebd-b3d0-597599e24c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:06.056397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094f355-bdcf-4ebd-b3d0-597599e24c10 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:06.062047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6202bfda-58fb-429f-9c5f-e5f88002e366 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:06.063397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6202bfda-58fb-429f-9c5f-e5f88002e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:06.075113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 774/1551] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:06.079803 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094f355-bdcf-4ebd-b3d0-597599e24c10 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:06.082897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 778/1552] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:59:06.094355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9258efd-bf95-42f2-9b1d-4017c70eec12 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.094560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9258efd-bf95-42f2-9b1d-4017c70eec12 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.094891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9258efd-bf95-42f2-9b1d-4017c70eec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.100682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094f355-bdcf-4ebd-b3d0-597599e24c10 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:06.110322 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ff6e4-06b9-412d-bb0d-3da2ba0a81d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:06.111272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ff6e4-06b9-412d-bb0d-3da2ba0a81d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.111506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ff6e4-06b9-412d-bb0d-3da2ba0a81d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.111789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ff6e4-06b9-412d-bb0d-3da2ba0a81d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.112550 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ff6e4-06b9-412d-bb0d-3da2ba0a81d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:06.115794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ff6e4-06b9-412d-bb0d-3da2ba0a81d4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:06.141079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 775/1553] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:06.143422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c9258efd-bf95-42f2-9b1d-4017c70eec12 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:06.144798 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c9258efd-bf95-42f2-9b1d-4017c70eec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:06.146723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ff6e4-06b9-412d-bb0d-3da2ba0a81d4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:06.171412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ff6e4-06b9-412d-bb0d-3da2ba0a81d4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:06.174104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 779/1554] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:06.179748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9258efd-bf95-42f2-9b1d-4017c70eec12 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:06.196597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c544052-6e6d-456a-a1d0-7715d4922c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:06.198005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c544052-6e6d-456a-a1d0-7715d4922c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.198297 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c544052-6e6d-456a-a1d0-7715d4922c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.198584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c544052-6e6d-456a-a1d0-7715d4922c4d admin admin] PATH_INFO: `/v3/projects/9d28b70e101744fca6ac45e676b8e721/users/0816329415384fffbe4b4d69b768d8c5/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.202191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9258efd-bf95-42f2-9b1d-4017c70eec12 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:06.221826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590a134-deaa-4660-b584-85ff3216745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:06.222522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a134-deaa-4660-b584-85ff3216745d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.222814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a134-deaa-4660-b584-85ff3216745d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.223101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a134-deaa-4660-b584-85ff3216745d admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.224292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590a134-deaa-4660-b584-85ff3216745d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:06.224613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590a134-deaa-4660-b584-85ff3216745d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:06.225926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-1590a134-deaa-4660-b584-85ff3216745d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:59:06.225926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: warnings.warn(msg) Jun 21 15:59:06.225926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: Jun 21 15:59:06.233008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590a134-deaa-4660-b584-85ff3216745d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:06.246857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c544052-6e6d-456a-a1d0-7715d4922c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d28b70e101744fca6ac45e676b8e721, user_id=0816329415384fffbe4b4d69b768d8c5, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:06.248837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: WARNING py.warnings [None req-4c544052-6e6d-456a-a1d0-7715d4922c4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:59:06.248837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: warnings.warn(msg) Jun 21 15:59:06.248837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: Jun 21 15:59:06.251313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c544052-6e6d-456a-a1d0-7715d4922c4d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:06.258170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 780/1555] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:06.271322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590a134-deaa-4660-b584-85ff3216745d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:06.288253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 776/1556] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:06 2022] PUT /identity/v3/projects/9d28b70e101744fca6ac45e676b8e721/users/0816329415384fffbe4b4d69b768d8c5/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:06.295549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590a134-deaa-4660-b584-85ff3216745d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:06.319085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c82a-3e86-4b86-9be7-77b344b68469 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.319085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c82a-3e86-4b86-9be7-77b344b68469 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.319085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c82a-3e86-4b86-9be7-77b344b68469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.379419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288a65b-2100-474d-aa9b-aa31c0c5540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:06.380055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288a65b-2100-474d-aa9b-aa31c0c5540d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.380348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288a65b-2100-474d-aa9b-aa31c0c5540d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.380631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288a65b-2100-474d-aa9b-aa31c0c5540d admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.381346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288a65b-2100-474d-aa9b-aa31c0c5540d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:06.387972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288a65b-2100-474d-aa9b-aa31c0c5540d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:06.396268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bdb2c82a-3e86-4b86-9be7-77b344b68469 None None] MFA Rules not processed for user `0816329415384fffbe4b4d69b768d8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:06.397556 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bdb2c82a-3e86-4b86-9be7-77b344b68469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:06.443390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 781/1557] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:06 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:06.451852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288a65b-2100-474d-aa9b-aa31c0c5540d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:06.556488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288a65b-2100-474d-aa9b-aa31c0c5540d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:06.576767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258afc6-3cfc-4937-8087-131290a2670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:06.577396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258afc6-3cfc-4937-8087-131290a2670a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.577889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258afc6-3cfc-4937-8087-131290a2670a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.578183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258afc6-3cfc-4937-8087-131290a2670a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.582622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258afc6-3cfc-4937-8087-131290a2670a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:06.582622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-1258afc6-3cfc-4937-8087-131290a2670a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:59:06.582622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: warnings.warn(msg) Jun 21 15:59:06.582622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: Jun 21 15:59:06.582622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258afc6-3cfc-4937-8087-131290a2670a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:06.665469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 782/1558] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:06 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:06.669650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49619cb3-4d42-4727-9d7f-9b0b714c87e9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.678387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49619cb3-4d42-4727-9d7f-9b0b714c87e9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.684052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49619cb3-4d42-4727-9d7f-9b0b714c87e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.699428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 777/1559] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:59:06.710076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2c82a-3e86-4b86-9be7-77b344b68469 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:06.777400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-49619cb3-4d42-4727-9d7f-9b0b714c87e9 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:06.778297 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2c82a-3e86-4b86-9be7-77b344b68469 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:06.780744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-49619cb3-4d42-4727-9d7f-9b0b714c87e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:06.791214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19fbd5-d4bb-4cd1-a015-30f49d1c6312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:06.791214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19fbd5-d4bb-4cd1-a015-30f49d1c6312 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.791214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19fbd5-d4bb-4cd1-a015-30f49d1c6312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.791214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19fbd5-d4bb-4cd1-a015-30f49d1c6312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.792076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19fbd5-d4bb-4cd1-a015-30f49d1c6312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:06.792076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19fbd5-d4bb-4cd1-a015-30f49d1c6312 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:06.809848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 783/1560] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:06.818364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e54f1-bed2-43dd-b9c7-82191cb8cda2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.819393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e54f1-bed2-43dd-b9c7-82191cb8cda2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.820234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e54f1-bed2-43dd-b9c7-82191cb8cda2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.824005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 784/1561] 10.222.0.46 () {54 vars in 961 bytes} [Tue Jun 21 15:59:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:59:06.830192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eac95-0612-46b2-b011-3fde46aceadd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.831456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 778/1562] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:06.833361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eac95-0612-46b2-b011-3fde46aceadd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.834258 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eac95-0612-46b2-b011-3fde46aceadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.839590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19fbd5-d4bb-4cd1-a015-30f49d1c6312 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:06.857841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:06.871291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19fbd5-d4bb-4cd1-a015-30f49d1c6312 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:06.877135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d9ed2-b44d-4dd5-bae9-dce1d4c85698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:06.877972 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d9ed2-b44d-4dd5-bae9-dce1d4c85698 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.878387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d9ed2-b44d-4dd5-bae9-dce1d4c85698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.884150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d9ed2-b44d-4dd5-bae9-dce1d4c85698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.885631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d9ed2-b44d-4dd5-bae9-dce1d4c85698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:06.888886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d9ed2-b44d-4dd5-bae9-dce1d4c85698 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:06.918281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a41eac95-0612-46b2-b011-3fde46aceadd None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:06.920943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a41eac95-0612-46b2-b011-3fde46aceadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:06.928554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 779/1563] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:06.933097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc78435-ccb1-43f2-bc89-b276f72686bb None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.933501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc78435-ccb1-43f2-bc89-b276f72686bb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.934159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc78435-ccb1-43f2-bc89-b276f72686bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:06.957570 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 785/1564] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:06.959085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446b80-9b68-4bcd-beee-f21d31f347a1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:06.959415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446b80-9b68-4bcd-beee-f21d31f347a1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:06.959722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446b80-9b68-4bcd-beee-f21d31f347a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.003766 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ccc78435-ccb1-43f2-bc89-b276f72686bb None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:07.014077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:07.015403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ccc78435-ccb1-43f2-bc89-b276f72686bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:07.037001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-53446b80-9b68-4bcd-beee-f21d31f347a1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:07.039445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-53446b80-9b68-4bcd-beee-f21d31f347a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:07.087677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 786/1565] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:07.090387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446b80-9b68-4bcd-beee-f21d31f347a1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:07.119191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446b80-9b68-4bcd-beee-f21d31f347a1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:07.148403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80147687-4dc4-4ad8-86e6-85fc4df8d536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:07.151587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80147687-4dc4-4ad8-86e6-85fc4df8d536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.152290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80147687-4dc4-4ad8-86e6-85fc4df8d536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.152952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80147687-4dc4-4ad8-86e6-85fc4df8d536 admin admin] PATH_INFO: `/v3/projects/57d2dd9dd7b64dcbab9384b1a884055a/users/a612f06750134cca9d7c8e9ba6c4a0aa/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.216082 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80147687-4dc4-4ad8-86e6-85fc4df8d536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d2dd9dd7b64dcbab9384b1a884055a, user_id=a612f06750134cca9d7c8e9ba6c4a0aa, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:07.222621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80147687-4dc4-4ad8-86e6-85fc4df8d536 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:07.270625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 787/1566] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:07 2022] PUT /identity/v3/projects/57d2dd9dd7b64dcbab9384b1a884055a/users/a612f06750134cca9d7c8e9ba6c4a0aa/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:07.271982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80147687-4dc4-4ad8-86e6-85fc4df8d536 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:07.282483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 780/1567] 10.222.0.46 () {58 vars in 1058 bytes} [Tue Jun 21 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:07.285118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869689-8e33-4d12-a937-d7a156a524c4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.292227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869689-8e33-4d12-a937-d7a156a524c4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.292861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869689-8e33-4d12-a937-d7a156a524c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.328283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-88869689-8e33-4d12-a937-d7a156a524c4 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:07.330021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-88869689-8e33-4d12-a937-d7a156a524c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:07.488124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80147687-4dc4-4ad8-86e6-85fc4df8d536 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:07.497305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3cb3b-c5de-41c6-988e-81f155ed2676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:07.498440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3cb3b-c5de-41c6-988e-81f155ed2676 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.498920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3cb3b-c5de-41c6-988e-81f155ed2676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.499428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3cb3b-c5de-41c6-988e-81f155ed2676 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.500805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3cb3b-c5de-41c6-988e-81f155ed2676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:07.501820 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3cb3b-c5de-41c6-988e-81f155ed2676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:07.505332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3cb3b-c5de-41c6-988e-81f155ed2676 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:07.531752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 788/1568] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:07.533184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 781/1569] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:07.533676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3cb3b-c5de-41c6-988e-81f155ed2676 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:07.542316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeee48b-d184-4431-9703-5ecee8b6f959 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.542847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeee48b-d184-4431-9703-5ecee8b6f959 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.543413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeee48b-d184-4431-9703-5ecee8b6f959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.614455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bbeee48b-d184-4431-9703-5ecee8b6f959 None None] MFA Rules not processed for user `a612f06750134cca9d7c8e9ba6c4a0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:07.616472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bbeee48b-d184-4431-9703-5ecee8b6f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:07.670011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3cb3b-c5de-41c6-988e-81f155ed2676 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:07.678650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7be5f4-6d66-4366-bdda-b73b3cd910a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:07.679753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7be5f4-6d66-4366-bdda-b73b3cd910a2 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.680226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7be5f4-6d66-4366-bdda-b73b3cd910a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.680689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7be5f4-6d66-4366-bdda-b73b3cd910a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.734497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 782/1570] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:07.736785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6759e00-88d2-4248-a6d4-efcb02d7f7d4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.737923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6759e00-88d2-4248-a6d4-efcb02d7f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.737923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6759e00-88d2-4248-a6d4-efcb02d7f7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.762403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c6759e00-88d2-4248-a6d4-efcb02d7f7d4 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:07.763885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c6759e00-88d2-4248-a6d4-efcb02d7f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:07.774036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 783/1571] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:07.776171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422967d-6ce3-406a-99c3-807558bf3633 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.776564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422967d-6ce3-406a-99c3-807558bf3633 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.776968 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422967d-6ce3-406a-99c3-807558bf3633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.783136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7be5f4-6d66-4366-bdda-b73b3cd910a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:07.786226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7be5f4-6d66-4366-bdda-b73b3cd910a2 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:07.797930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:07.805366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 789/1572] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:07.807214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7be5f4-6d66-4366-bdda-b73b3cd910a2 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:07.808163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0422967d-6ce3-406a-99c3-807558bf3633 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:07.810361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0422967d-6ce3-406a-99c3-807558bf3633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:07.827237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 784/1573] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:07.827237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422967d-6ce3-406a-99c3-807558bf3633 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:07.830294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7be5f4-6d66-4366-bdda-b73b3cd910a2 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:07.848244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20b490-2650-4eb7-83f5-2c1b0a4ad212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:07.849452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20b490-2650-4eb7-83f5-2c1b0a4ad212 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.850000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20b490-2650-4eb7-83f5-2c1b0a4ad212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.850500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20b490-2650-4eb7-83f5-2c1b0a4ad212 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.851962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20b490-2650-4eb7-83f5-2c1b0a4ad212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:07.852502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20b490-2650-4eb7-83f5-2c1b0a4ad212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:07.856522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20b490-2650-4eb7-83f5-2c1b0a4ad212 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:07.856987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422967d-6ce3-406a-99c3-807558bf3633 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:07.861668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:07.866188 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4121-c61a-4084-bf37-9e25ac9a66f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:07.867656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4121-c61a-4084-bf37-9e25ac9a66f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.868131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4121-c61a-4084-bf37-9e25ac9a66f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.868593 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4121-c61a-4084-bf37-9e25ac9a66f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.870578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd4121-c61a-4084-bf37-9e25ac9a66f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:07.872685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: WARNING py.warnings [None req-f9bd4121-c61a-4084-bf37-9e25ac9a66f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:59:07.872685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: warnings.warn(msg) Jun 21 15:59:07.872685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: Jun 21 15:59:07.874860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd4121-c61a-4084-bf37-9e25ac9a66f9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:07.884208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 790/1574] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:07.887309 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07290880-2d8d-49d1-94a6-18d02cfddb2d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.887903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07290880-2d8d-49d1-94a6-18d02cfddb2d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.888848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07290880-2d8d-49d1-94a6-18d02cfddb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.924917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 785/1575] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:07 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:07.926071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-07290880-2d8d-49d1-94a6-18d02cfddb2d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:07.926856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef18e7-29a3-484c-946c-8aaa2542db68 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:07.927361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef18e7-29a3-484c-946c-8aaa2542db68 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:07.927809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef18e7-29a3-484c-946c-8aaa2542db68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:07.929393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-07290880-2d8d-49d1-94a6-18d02cfddb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:07.971463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bdef18e7-29a3-484c-946c-8aaa2542db68 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:07.973892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bdef18e7-29a3-484c-946c-8aaa2542db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:08.027532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 791/1576] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:08.029083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07290880-2d8d-49d1-94a6-18d02cfddb2d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.048524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07290880-2d8d-49d1-94a6-18d02cfddb2d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.057273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a310e7-65e4-4e0f-91e2-1c28392fdf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.059098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a310e7-65e4-4e0f-91e2-1c28392fdf48 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.059648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a310e7-65e4-4e0f-91e2-1c28392fdf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.060166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a310e7-65e4-4e0f-91e2-1c28392fdf48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.061514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a310e7-65e4-4e0f-91e2-1c28392fdf48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.065451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a310e7-65e4-4e0f-91e2-1c28392fdf48 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.090714 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 786/1577] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:08.092167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b19a1-6888-49de-b791-70b64f95b8a5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.092615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b19a1-6888-49de-b791-70b64f95b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.092959 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b19a1-6888-49de-b791-70b64f95b8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.123368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-260b19a1-6888-49de-b791-70b64f95b8a5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:08.124029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 792/1578] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:08.125625 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-260b19a1-6888-49de-b791-70b64f95b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:08.125836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65a8f-688b-490b-9b16-5ea0a72dafed None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.126262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65a8f-688b-490b-9b16-5ea0a72dafed None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.126737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e65a8f-688b-490b-9b16-5ea0a72dafed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.168554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-40e65a8f-688b-490b-9b16-5ea0a72dafed None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:08.172936 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-40e65a8f-688b-490b-9b16-5ea0a72dafed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:08.207146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 787/1579] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:08.208409 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b19a1-6888-49de-b791-70b64f95b8a5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.226809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b19a1-6888-49de-b791-70b64f95b8a5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.235636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d84ac-bb6a-464d-8c01-a55ec682a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.236753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d84ac-bb6a-464d-8c01-a55ec682a49c admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.237230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d84ac-bb6a-464d-8c01-a55ec682a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.237736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d84ac-bb6a-464d-8c01-a55ec682a49c admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.238953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d84ac-bb6a-464d-8c01-a55ec682a49c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.242742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d84ac-bb6a-464d-8c01-a55ec682a49c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.268876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 793/1580] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:08.274787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e65a8f-688b-490b-9b16-5ea0a72dafed None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.287967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e65a8f-688b-490b-9b16-5ea0a72dafed None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.289225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 788/1581] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:08.291073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c579-09f3-40ff-aab0-43f2536c9f32 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.292548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c579-09f3-40ff-aab0-43f2536c9f32 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.292779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c579-09f3-40ff-aab0-43f2536c9f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.322837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9345c579-09f3-40ff-aab0-43f2536c9f32 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:08.325214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9345c579-09f3-40ff-aab0-43f2536c9f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:08.379409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf2c2e-dd76-4f40-b0fe-591398d7cc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.380638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf2c2e-dd76-4f40-b0fe-591398d7cc0c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.381242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf2c2e-dd76-4f40-b0fe-591398d7cc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.381798 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf2c2e-dd76-4f40-b0fe-591398d7cc0c admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.383151 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf2c2e-dd76-4f40-b0fe-591398d7cc0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.387754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf2c2e-dd76-4f40-b0fe-591398d7cc0c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.398634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:08.417041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 789/1582] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:08.419719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894fa4c-8860-4c8a-bdba-026ad9f9dd70 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.420517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894fa4c-8860-4c8a-bdba-026ad9f9dd70 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.421311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894fa4c-8860-4c8a-bdba-026ad9f9dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.423838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 794/1583] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:08.425619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c260d-ac18-41ff-8d20-e067bc6aea0d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.426124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c260d-ac18-41ff-8d20-e067bc6aea0d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.426523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c260d-ac18-41ff-8d20-e067bc6aea0d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.428601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 795/1584] 10.222.0.46 () {54 vars in 912 bytes} [Tue Jun 21 15:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:59:08.429978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c260d-ac18-41ff-8d20-e067bc6aea0d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.441470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:08.450482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2894fa4c-8860-4c8a-bdba-026ad9f9dd70 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:08.452549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2894fa4c-8860-4c8a-bdba-026ad9f9dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:08.452761 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c260d-ac18-41ff-8d20-e067bc6aea0d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.460618 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60e4aa-c6fb-42fb-a900-3d65667d5261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.461500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60e4aa-c6fb-42fb-a900-3d65667d5261 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.461892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60e4aa-c6fb-42fb-a900-3d65667d5261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.462273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60e4aa-c6fb-42fb-a900-3d65667d5261 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.463690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60e4aa-c6fb-42fb-a900-3d65667d5261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.464862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 790/1585] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:08.466162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894fa4c-8860-4c8a-bdba-026ad9f9dd70 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.466672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60e4aa-c6fb-42fb-a900-3d65667d5261 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.482404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894fa4c-8860-4c8a-bdba-026ad9f9dd70 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.493590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c31ec-3233-474a-934d-d61d84864e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.494758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c31ec-3233-474a-934d-d61d84864e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.495294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c31ec-3233-474a-934d-d61d84864e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.495748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c31ec-3233-474a-934d-d61d84864e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.497046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c31ec-3233-474a-934d-d61d84864e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:08.497939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c31ec-3233-474a-934d-d61d84864e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.498140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 796/1586] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/users => generated 297 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:08.499018 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60e4aa-c6fb-42fb-a900-3d65667d5261 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.500876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c31ec-3233-474a-934d-d61d84864e25 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.517454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60e4aa-c6fb-42fb-a900-3d65667d5261 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.523246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 791/1587] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:08.524631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c31ec-3233-474a-934d-d61d84864e25 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.527665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0255eb-58ec-485d-b35a-97416fd9e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.528882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0255eb-58ec-485d-b35a-97416fd9e89b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.529480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0255eb-58ec-485d-b35a-97416fd9e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.530090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0255eb-58ec-485d-b35a-97416fd9e89b admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.531969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0255eb-58ec-485d-b35a-97416fd9e89b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:08.532678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0255eb-58ec-485d-b35a-97416fd9e89b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.537122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0255eb-58ec-485d-b35a-97416fd9e89b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.546190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c31ec-3233-474a-934d-d61d84864e25 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.554513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26694099-ecea-40d4-96c5-0cc62db749a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.555149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 797/1588] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:08.555733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26694099-ecea-40d4-96c5-0cc62db749a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.556233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0255eb-58ec-485d-b35a-97416fd9e89b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.556417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26694099-ecea-40d4-96c5-0cc62db749a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.556945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26694099-ecea-40d4-96c5-0cc62db749a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.558558 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26694099-ecea-40d4-96c5-0cc62db749a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.562525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26694099-ecea-40d4-96c5-0cc62db749a6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.568730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0255eb-58ec-485d-b35a-97416fd9e89b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.574276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e27b1-cd95-4e3c-95c1-3e32a86aa7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.575202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e27b1-cd95-4e3c-95c1-3e32a86aa7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.575489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e27b1-cd95-4e3c-95c1-3e32a86aa7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.575786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e27b1-cd95-4e3c-95c1-3e32a86aa7d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.576525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e27b1-cd95-4e3c-95c1-3e32a86aa7d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:08.576837 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e27b1-cd95-4e3c-95c1-3e32a86aa7d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.578493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e27b1-cd95-4e3c-95c1-3e32a86aa7d9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.594288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 792/1589] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/users => generated 288 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:08.595722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26694099-ecea-40d4-96c5-0cc62db749a6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.602714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 798/1590] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:08.606567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e145f9-38a6-4d99-8377-2e2043957b45 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.607098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e145f9-38a6-4d99-8377-2e2043957b45 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.607650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e145f9-38a6-4d99-8377-2e2043957b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.608953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26694099-ecea-40d4-96c5-0cc62db749a6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.614292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530c59-567a-4fb0-9c3a-a3590277d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.615136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530c59-567a-4fb0-9c3a-a3590277d4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.615567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530c59-567a-4fb0-9c3a-a3590277d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.615935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530c59-567a-4fb0-9c3a-a3590277d4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.616773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530c59-567a-4fb0-9c3a-a3590277d4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.618558 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530c59-567a-4fb0-9c3a-a3590277d4d3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.634554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-76e145f9-38a6-4d99-8377-2e2043957b45 None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:08.638096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 793/1591] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:08.638361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-76e145f9-38a6-4d99-8377-2e2043957b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:08.638570 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530c59-567a-4fb0-9c3a-a3590277d4d3 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.654812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530c59-567a-4fb0-9c3a-a3590277d4d3 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.661993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bedfd-5208-483c-959d-80d6c41b0f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.662759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bedfd-5208-483c-959d-80d6c41b0f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.663106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bedfd-5208-483c-959d-80d6c41b0f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.663501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bedfd-5208-483c-959d-80d6c41b0f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.664452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bedfd-5208-483c-959d-80d6c41b0f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:08.664853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bedfd-5208-483c-959d-80d6c41b0f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.667191 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bedfd-5208-483c-959d-80d6c41b0f42 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.685136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 794/1592] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:08.686882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bedfd-5208-483c-959d-80d6c41b0f42 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.705115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bedfd-5208-483c-959d-80d6c41b0f42 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.717053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492be6a-3784-4667-bbce-b02289a3567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.718430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492be6a-3784-4667-bbce-b02289a3567f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.719634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492be6a-3784-4667-bbce-b02289a3567f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.720021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492be6a-3784-4667-bbce-b02289a3567f admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.721002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492be6a-3784-4667-bbce-b02289a3567f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.723254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492be6a-3784-4667-bbce-b02289a3567f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.743419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 795/1593] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:08.743419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492be6a-3784-4667-bbce-b02289a3567f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.751225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 799/1594] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:08.752263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e145f9-38a6-4d99-8377-2e2043957b45 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.755959 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492be6a-3784-4667-bbce-b02289a3567f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.765143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e145f9-38a6-4d99-8377-2e2043957b45 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.767893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c83005-aafc-4cf3-8d3c-f6dc856b6ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.768801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83005-aafc-4cf3-8d3c-f6dc856b6ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.769272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83005-aafc-4cf3-8d3c-f6dc856b6ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.769658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83005-aafc-4cf3-8d3c-f6dc856b6ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.770411 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac6cc4-98fa-4158-8466-756f25000565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.770727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c83005-aafc-4cf3-8d3c-f6dc856b6ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.771091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac6cc4-98fa-4158-8466-756f25000565 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.771496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac6cc4-98fa-4158-8466-756f25000565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.771754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac6cc4-98fa-4158-8466-756f25000565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.772467 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac6cc4-98fa-4158-8466-756f25000565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.773448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c83005-aafc-4cf3-8d3c-f6dc856b6ec6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.774428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac6cc4-98fa-4158-8466-756f25000565 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.808164 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 796/1595] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/projects => generated 405 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:08.809498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c83005-aafc-4cf3-8d3c-f6dc856b6ec6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.815221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 800/1596] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:08.816215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac6cc4-98fa-4158-8466-756f25000565 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:08.910469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c83005-aafc-4cf3-8d3c-f6dc856b6ec6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.926412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac6cc4-98fa-4158-8466-756f25000565 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:08.931612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea10f5-2d59-4fb5-8f3d-b52af1b322d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:08.932316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea10f5-2d59-4fb5-8f3d-b52af1b322d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:08.932599 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea10f5-2d59-4fb5-8f3d-b52af1b322d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:08.932879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea10f5-2d59-4fb5-8f3d-b52af1b322d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:08.933603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea10f5-2d59-4fb5-8f3d-b52af1b322d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:08.935953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea10f5-2d59-4fb5-8f3d-b52af1b322d5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:08.972349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 801/1597] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:08 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:08.973902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea10f5-2d59-4fb5-8f3d-b52af1b322d5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.000412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:09.005236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb6c1f-9785-437c-8ee1-98c2410ae73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.005944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb6c1f-9785-437c-8ee1-98c2410ae73c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.006237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb6c1f-9785-437c-8ee1-98c2410ae73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.006691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb6c1f-9785-437c-8ee1-98c2410ae73c admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.007498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb6c1f-9785-437c-8ee1-98c2410ae73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.009796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb6c1f-9785-437c-8ee1-98c2410ae73c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.029638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 797/1598] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:09.030522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb6c1f-9785-437c-8ee1-98c2410ae73c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.042397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb6c1f-9785-437c-8ee1-98c2410ae73c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.047511 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:09.089462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea10f5-2d59-4fb5-8f3d-b52af1b322d5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.095437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f6d1b-8312-4f93-9e42-902a76f252e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.096165 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f6d1b-8312-4f93-9e42-902a76f252e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.096463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f6d1b-8312-4f93-9e42-902a76f252e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.096745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f6d1b-8312-4f93-9e42-902a76f252e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.097511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f6d1b-8312-4f93-9e42-902a76f252e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.099788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f6d1b-8312-4f93-9e42-902a76f252e2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.114650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 802/1599] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:09.115572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f6d1b-8312-4f93-9e42-902a76f252e2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.123402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f79c01-6b9e-4871-bca4-61ad1e4a6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.124107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f79c01-6b9e-4871-bca4-61ad1e4a6aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.124459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f79c01-6b9e-4871-bca4-61ad1e4a6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.124788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f79c01-6b9e-4871-bca4-61ad1e4a6aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.125724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f79c01-6b9e-4871-bca4-61ad1e4a6aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.127127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f6d1b-8312-4f93-9e42-902a76f252e2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.128109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f79c01-6b9e-4871-bca4-61ad1e4a6aa5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.133017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475de45-580d-4d24-a085-28418ae3c9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.134160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475de45-580d-4d24-a085-28418ae3c9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.134457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475de45-580d-4d24-a085-28418ae3c9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.134856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475de45-580d-4d24-a085-28418ae3c9b8 admin admin] PATH_INFO: `/v3/projects/57bd1659f31048439890db2fb989d488/users/c5ce280d5de842d78e59a6c75b2582b1/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.154716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475de45-580d-4d24-a085-28418ae3c9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bd1659f31048439890db2fb989d488, user_id=c5ce280d5de842d78e59a6c75b2582b1, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.160480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475de45-580d-4d24-a085-28418ae3c9b8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.168122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 798/1600] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:09 2022] POST /identity/v3/projects => generated 393 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:09.169221 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f79c01-6b9e-4871-bca4-61ad1e4a6aa5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.184534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 803/1601] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:09 2022] PUT /identity/v3/projects/57bd1659f31048439890db2fb989d488/users/c5ce280d5de842d78e59a6c75b2582b1/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:09.186019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475de45-580d-4d24-a085-28418ae3c9b8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.238742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f79c01-6b9e-4871-bca4-61ad1e4a6aa5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.288911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475de45-580d-4d24-a085-28418ae3c9b8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.294939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a551f77-8964-4c0e-9cba-88d473d6582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.295669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a551f77-8964-4c0e-9cba-88d473d6582f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.295950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a551f77-8964-4c0e-9cba-88d473d6582f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.296234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a551f77-8964-4c0e-9cba-88d473d6582f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.296954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a551f77-8964-4c0e-9cba-88d473d6582f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.298952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a551f77-8964-4c0e-9cba-88d473d6582f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.313438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cce067-180a-4107-927f-c34535a17cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.314644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cce067-180a-4107-927f-c34535a17cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.315037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cce067-180a-4107-927f-c34535a17cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.315664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cce067-180a-4107-927f-c34535a17cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.324534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 804/1602] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:09 2022] POST /identity/v3/users => generated 303 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:09.325644 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a551f77-8964-4c0e-9cba-88d473d6582f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.337538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a551f77-8964-4c0e-9cba-88d473d6582f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.343687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29423ab2-c890-4ebd-a427-e34425227573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.344456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29423ab2-c890-4ebd-a427-e34425227573 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.344746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29423ab2-c890-4ebd-a427-e34425227573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.345049 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29423ab2-c890-4ebd-a427-e34425227573 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.345778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29423ab2-c890-4ebd-a427-e34425227573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.347867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29423ab2-c890-4ebd-a427-e34425227573 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.380401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 805/1603] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:09 2022] POST /identity/v3/users => generated 303 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:09.382022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29423ab2-c890-4ebd-a427-e34425227573 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.398945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29423ab2-c890-4ebd-a427-e34425227573 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.402093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:09.406291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefec6d-181b-458f-91cd-e68932a7ef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.406991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefec6d-181b-458f-91cd-e68932a7ef0e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.407647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefec6d-181b-458f-91cd-e68932a7ef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.407647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefec6d-181b-458f-91cd-e68932a7ef0e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.408379 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefec6d-181b-458f-91cd-e68932a7ef0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.410508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefec6d-181b-458f-91cd-e68932a7ef0e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.423271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cce067-180a-4107-927f-c34535a17cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.425230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cce067-180a-4107-927f-c34535a17cd3 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.440412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 806/1604] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:09 2022] POST /identity/v3/users => generated 290 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:09.441533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefec6d-181b-458f-91cd-e68932a7ef0e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.442578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 799/1605] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:09.444270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cce067-180a-4107-927f-c34535a17cd3 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.457214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefec6d-181b-458f-91cd-e68932a7ef0e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.458652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cce067-180a-4107-927f-c34535a17cd3 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.462738 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4987b3-7edf-4a32-9873-b8c057595f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.464160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4987b3-7edf-4a32-9873-b8c057595f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.464459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4987b3-7edf-4a32-9873-b8c057595f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.464748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4987b3-7edf-4a32-9873-b8c057595f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.465389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8342732-40c4-4890-85cf-c6504ad25a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.465583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4987b3-7edf-4a32-9873-b8c057595f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.466616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342732-40c4-4890-85cf-c6504ad25a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.467106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342732-40c4-4890-85cf-c6504ad25a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.467345 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4987b3-7edf-4a32-9873-b8c057595f24 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.467819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342732-40c4-4890-85cf-c6504ad25a9c admin admin] PATH_INFO: `/v3/projects/8e0314c15067472881d1905c6593110e/users/09981b4e63fa4e43b38601d323880167/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.481739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 807/1606] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:09.482298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4987b3-7edf-4a32-9873-b8c057595f24 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.496187 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4987b3-7edf-4a32-9873-b8c057595f24 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.497123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8342732-40c4-4890-85cf-c6504ad25a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0314c15067472881d1905c6593110e, user_id=09981b4e63fa4e43b38601d323880167, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.501291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8342732-40c4-4890-85cf-c6504ad25a9c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.501732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd107c-6ae8-421b-b04e-ae822935a938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.502354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd107c-6ae8-421b-b04e-ae822935a938 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.502650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd107c-6ae8-421b-b04e-ae822935a938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.502932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd107c-6ae8-421b-b04e-ae822935a938 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.503702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd107c-6ae8-421b-b04e-ae822935a938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.505686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd107c-6ae8-421b-b04e-ae822935a938 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.522972 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 800/1607] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:09 2022] PUT /identity/v3/projects/8e0314c15067472881d1905c6593110e/users/09981b4e63fa4e43b38601d323880167/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:09.524436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8342732-40c4-4890-85cf-c6504ad25a9c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.534136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 808/1608] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:09 2022] POST /identity/v3/users => generated 297 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:09.535092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd107c-6ae8-421b-b04e-ae822935a938 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.551729 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd107c-6ae8-421b-b04e-ae822935a938 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.564269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:09.654095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8342732-40c4-4890-85cf-c6504ad25a9c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.658948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849ac6-0d3f-4815-bffd-9710735d3bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.660009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849ac6-0d3f-4815-bffd-9710735d3bda admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.660477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849ac6-0d3f-4815-bffd-9710735d3bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.660890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849ac6-0d3f-4815-bffd-9710735d3bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.662195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac849ac6-0d3f-4815-bffd-9710735d3bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.662648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a474f-3b20-427c-bf7b-2f27517998da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.664006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a474f-3b20-427c-bf7b-2f27517998da admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.664529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a474f-3b20-427c-bf7b-2f27517998da admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.665037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a474f-3b20-427c-bf7b-2f27517998da admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.665579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac849ac6-0d3f-4815-bffd-9710735d3bda admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.667104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a474f-3b20-427c-bf7b-2f27517998da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.670916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a474f-3b20-427c-bf7b-2f27517998da admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.687886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 809/1609] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:09.687886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849ac6-0d3f-4815-bffd-9710735d3bda admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.695134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849ac6-0d3f-4815-bffd-9710735d3bda admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.707948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9f24a-e358-4c46-aaa3-2f3372551a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.708486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 801/1610] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:09.708669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9f24a-e358-4c46-aaa3-2f3372551a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.708669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9f24a-e358-4c46-aaa3-2f3372551a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.708669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9f24a-e358-4c46-aaa3-2f3372551a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.709075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a474f-3b20-427c-bf7b-2f27517998da admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.709234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9f24a-e358-4c46-aaa3-2f3372551a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.709234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9f24a-e358-4c46-aaa3-2f3372551a5a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.723915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 810/1611] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:09.723915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9f24a-e358-4c46-aaa3-2f3372551a5a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.731150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a474f-3b20-427c-bf7b-2f27517998da admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.734663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9f24a-e358-4c46-aaa3-2f3372551a5a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.738232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854874a-5fc3-4e57-9ac2-d217be2c5ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.739456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854874a-5fc3-4e57-9ac2-d217be2c5ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.739973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854874a-5fc3-4e57-9ac2-d217be2c5ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.740288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc0bb-1175-4dbc-80f7-be839bad9ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.740733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854874a-5fc3-4e57-9ac2-d217be2c5ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.741455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc0bb-1175-4dbc-80f7-be839bad9ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.741953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc0bb-1175-4dbc-80f7-be839bad9ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.742142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854874a-5fc3-4e57-9ac2-d217be2c5ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.742336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc0bb-1175-4dbc-80f7-be839bad9ce3 admin admin] PATH_INFO: `/v3/projects/ce60525d6df54630b29d1f8d6c54c68d/users/e3dde213de504589bf59ec0b410a693d/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.745923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854874a-5fc3-4e57-9ac2-d217be2c5ad1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.763055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 802/1612] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:09.763968 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854874a-5fc3-4e57-9ac2-d217be2c5ad1 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.776031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc0bb-1175-4dbc-80f7-be839bad9ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce60525d6df54630b29d1f8d6c54c68d, user_id=e3dde213de504589bf59ec0b410a693d, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.776828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854874a-5fc3-4e57-9ac2-d217be2c5ad1 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.781229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc0bb-1175-4dbc-80f7-be839bad9ce3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.781575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da01a9-38b7-4ec9-8b26-8e123a2829b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.782303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da01a9-38b7-4ec9-8b26-8e123a2829b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.782592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da01a9-38b7-4ec9-8b26-8e123a2829b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.782930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da01a9-38b7-4ec9-8b26-8e123a2829b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.784263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da01a9-38b7-4ec9-8b26-8e123a2829b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.787481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da01a9-38b7-4ec9-8b26-8e123a2829b8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.812767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 803/1613] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:09.813617 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 811/1614] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:09 2022] PUT /identity/v3/projects/ce60525d6df54630b29d1f8d6c54c68d/users/e3dde213de504589bf59ec0b410a693d/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:09.814953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc0bb-1175-4dbc-80f7-be839bad9ce3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.815101 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e652e-e29d-4b49-a048-e4b42caa2b22 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.815483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e652e-e29d-4b49-a048-e4b42caa2b22 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.815942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e652e-e29d-4b49-a048-e4b42caa2b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.879523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-cc4e652e-e29d-4b49-a048-e4b42caa2b22 None None] MFA Rules not processed for user `09981b4e63fa4e43b38601d323880167`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:09.881923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cc4e652e-e29d-4b49-a048-e4b42caa2b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:09.912476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc0bb-1175-4dbc-80f7-be839bad9ce3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.920336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8275c0b-55f1-47bd-90bd-9c8444af9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.920989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8275c0b-55f1-47bd-90bd-9c8444af9014 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.921492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8275c0b-55f1-47bd-90bd-9c8444af9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.921950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8275c0b-55f1-47bd-90bd-9c8444af9014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.923193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8275c0b-55f1-47bd-90bd-9c8444af9014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.925213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8275c0b-55f1-47bd-90bd-9c8444af9014 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:09.955549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 812/1615] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:09.961676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8275c0b-55f1-47bd-90bd-9c8444af9014 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.977400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8275c0b-55f1-47bd-90bd-9c8444af9014 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:09.989078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 804/1616] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:09.989360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17cf0d-008e-4964-929c-7a95f48d9b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:09.989609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e652e-e29d-4b49-a048-e4b42caa2b22 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:09.989791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17cf0d-008e-4964-929c-7a95f48d9b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:09.989791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17cf0d-008e-4964-929c-7a95f48d9b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:09.989791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17cf0d-008e-4964-929c-7a95f48d9b6f admin admin] PATH_INFO: `/v3/projects/57bd1659f31048439890db2fb989d488/users/c5ce280d5de842d78e59a6c75b2582b1/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:09.992803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17cf0d-008e-4964-929c-7a95f48d9b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bd1659f31048439890db2fb989d488, user_id=c5ce280d5de842d78e59a6c75b2582b1, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:09.997653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17cf0d-008e-4964-929c-7a95f48d9b6f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:10.004782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e652e-e29d-4b49-a048-e4b42caa2b22 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:10.011534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 813/1617] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:09 2022] PUT /identity/v3/projects/57bd1659f31048439890db2fb989d488/users/c5ce280d5de842d78e59a6c75b2582b1/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:10.012405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17cf0d-008e-4964-929c-7a95f48d9b6f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:10.050561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:10.097596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9883681-6791-4eb7-8792-f75e71a10ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:10.098433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9883681-6791-4eb7-8792-f75e71a10ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.098804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9883681-6791-4eb7-8792-f75e71a10ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.099211 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9883681-6791-4eb7-8792-f75e71a10ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.100067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9883681-6791-4eb7-8792-f75e71a10ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:10.101865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9883681-6791-4eb7-8792-f75e71a10ae0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:10.123402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 805/1618] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:10.124605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9883681-6791-4eb7-8792-f75e71a10ae0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:10.137344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9883681-6791-4eb7-8792-f75e71a10ae0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:10.143863 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5797db2-be61-48e4-be1a-0a1674a5f9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:10.144726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5797db2-be61-48e4-be1a-0a1674a5f9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.145062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5797db2-be61-48e4-be1a-0a1674a5f9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.145305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5797db2-be61-48e4-be1a-0a1674a5f9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.146109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5797db2-be61-48e4-be1a-0a1674a5f9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:10.147818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5797db2-be61-48e4-be1a-0a1674a5f9d9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:10.156167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:10.163620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17cf0d-008e-4964-929c-7a95f48d9b6f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:10.175048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 806/1619] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:10.175853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d62df-8509-4fc7-93f7-54563dd71ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:10.176069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f708439-5cd7-470f-b4fe-a040b01d6153 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.176069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f708439-5cd7-470f-b4fe-a040b01d6153 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.176069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f708439-5cd7-470f-b4fe-a040b01d6153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.176805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d62df-8509-4fc7-93f7-54563dd71ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.176805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d62df-8509-4fc7-93f7-54563dd71ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.176805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d62df-8509-4fc7-93f7-54563dd71ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.176805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d62df-8509-4fc7-93f7-54563dd71ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:10.179803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d62df-8509-4fc7-93f7-54563dd71ebc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:10.203833 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 814/1620] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:10.205469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d62df-8509-4fc7-93f7-54563dd71ebc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:10.208009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5f708439-5cd7-470f-b4fe-a040b01d6153 None None] MFA Rules not processed for user `e3dde213de504589bf59ec0b410a693d`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:10.209288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5f708439-5cd7-470f-b4fe-a040b01d6153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:10.226889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d62df-8509-4fc7-93f7-54563dd71ebc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:10.237482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70a10b-bfc7-4c70-8a6c-6642b5223cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:10.239135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a10b-bfc7-4c70-8a6c-6642b5223cef admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.240021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a10b-bfc7-4c70-8a6c-6642b5223cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.240646 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a10b-bfc7-4c70-8a6c-6642b5223cef admin admin] PATH_INFO: `/v3/projects/1d58e3220f7e4cfabbd3279745fd1a38/users/f217871fca5943ff9888b5e318d86296/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.282382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70a10b-bfc7-4c70-8a6c-6642b5223cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d58e3220f7e4cfabbd3279745fd1a38, user_id=f217871fca5943ff9888b5e318d86296, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:10.287631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70a10b-bfc7-4c70-8a6c-6642b5223cef admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:10.310045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 807/1621] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:10.311436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f708439-5cd7-470f-b4fe-a040b01d6153 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:10.324563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 815/1622] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:10 2022] PUT /identity/v3/projects/1d58e3220f7e4cfabbd3279745fd1a38/users/f217871fca5943ff9888b5e318d86296/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:10.327044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f708439-5cd7-470f-b4fe-a040b01d6153 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:10.327697 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eff2eb-4f59-46c6-98a3-8480035c0f39 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.328505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eff2eb-4f59-46c6-98a3-8480035c0f39 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.336559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eff2eb-4f59-46c6-98a3-8480035c0f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.410331 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-90eff2eb-4f59-46c6-98a3-8480035c0f39 None None] MFA Rules not processed for user `c5ce280d5de842d78e59a6c75b2582b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:10.412342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-90eff2eb-4f59-46c6-98a3-8480035c0f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:10.463922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960546e-e023-401a-a3b9-81394bbb8e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:10.464941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960546e-e023-401a-a3b9-81394bbb8e08 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.465475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960546e-e023-401a-a3b9-81394bbb8e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.466176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960546e-e023-401a-a3b9-81394bbb8e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.467537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960546e-e023-401a-a3b9-81394bbb8e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:10.472565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960546e-e023-401a-a3b9-81394bbb8e08 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:10.514419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 808/1623] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:10 2022] POST /identity/v3/projects => generated 363 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:10.516298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960546e-e023-401a-a3b9-81394bbb8e08 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:10.520983 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 816/1624] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:10.521961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eff2eb-4f59-46c6-98a3-8480035c0f39 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:10.534695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eff2eb-4f59-46c6-98a3-8480035c0f39 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:10.570583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:10.620442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960546e-e023-401a-a3b9-81394bbb8e08 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:10.622489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bc6e2-622d-493d-8d4e-f07f61e652ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:10.623776 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc6e2-622d-493d-8d4e-f07f61e652ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.624160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc6e2-622d-493d-8d4e-f07f61e652ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.624552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc6e2-622d-493d-8d4e-f07f61e652ba admin admin] PATH_INFO: `/v3/projects/3315d45f6a8746418a65277e2ae89a85/users/74f447686a3a41ef8300b20c04c9776a/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.625697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0760b4-1a79-40f6-a2a5-2d4a8d399f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:10.626658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0760b4-1a79-40f6-a2a5-2d4a8d399f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.626948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0760b4-1a79-40f6-a2a5-2d4a8d399f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.627256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0760b4-1a79-40f6-a2a5-2d4a8d399f93 admin admin] PATH_INFO: `/v3/projects/0a92c5b8585a42f2841375b6c5fd5f5e/users/9750c692f9ef4afa8a897747b5c11a81/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.644161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bc6e2-622d-493d-8d4e-f07f61e652ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3315d45f6a8746418a65277e2ae89a85, user_id=74f447686a3a41ef8300b20c04c9776a, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:10.646986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bc6e2-622d-493d-8d4e-f07f61e652ba admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:10.648186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0760b4-1a79-40f6-a2a5-2d4a8d399f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a92c5b8585a42f2841375b6c5fd5f5e, user_id=9750c692f9ef4afa8a897747b5c11a81, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:10.652596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0760b4-1a79-40f6-a2a5-2d4a8d399f93 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:10.667540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 817/1625] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:10 2022] PUT /identity/v3/projects/3315d45f6a8746418a65277e2ae89a85/users/74f447686a3a41ef8300b20c04c9776a/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:10.669123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bc6e2-622d-493d-8d4e-f07f61e652ba admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:10.676044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 809/1626] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:10 2022] PUT /identity/v3/projects/0a92c5b8585a42f2841375b6c5fd5f5e/users/9750c692f9ef4afa8a897747b5c11a81/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:10.677657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560ee3-906e-4fdb-92d8-4f87f08446a4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.678130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560ee3-906e-4fdb-92d8-4f87f08446a4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.678614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560ee3-906e-4fdb-92d8-4f87f08446a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.714923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b3560ee3-906e-4fdb-92d8-4f87f08446a4 None None] MFA Rules not processed for user `f217871fca5943ff9888b5e318d86296`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:10.716559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b3560ee3-906e-4fdb-92d8-4f87f08446a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:10.734675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:10.775886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bc6e2-622d-493d-8d4e-f07f61e652ba admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:10.803655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 810/1627] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:10.805156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c148e-be75-412c-866f-333a8aabc4ac None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.805455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c148e-be75-412c-866f-333a8aabc4ac None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.805735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c148e-be75-412c-866f-333a8aabc4ac None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.808490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 811/1628] 10.222.0.46 () {54 vars in 961 bytes} [Tue Jun 21 15:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:59:10.809371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c148e-be75-412c-866f-333a8aabc4ac None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:10.862584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fd782-fe3c-4e5f-9f3f-92e560990e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:10.863534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd782-fe3c-4e5f-9f3f-92e560990e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:10.863821 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd782-fe3c-4e5f-9f3f-92e560990e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:10.864119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd782-fe3c-4e5f-9f3f-92e560990e76 admin admin] PATH_INFO: `/v3/projects/4963922b0fac423e866016b1fa2f0d1c/users/d2359b672db844c6a081df3267b0f9fd/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:10.882566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fd782-fe3c-4e5f-9f3f-92e560990e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4963922b0fac423e866016b1fa2f0d1c, user_id=d2359b672db844c6a081df3267b0f9fd, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:10.886731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fd782-fe3c-4e5f-9f3f-92e560990e76 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:10.905868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 818/1629] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:10 2022] PUT /identity/v3/projects/4963922b0fac423e866016b1fa2f0d1c/users/d2359b672db844c6a081df3267b0f9fd/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:10.907233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fd782-fe3c-4e5f-9f3f-92e560990e76 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:10.933379 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c148e-be75-412c-866f-333a8aabc4ac None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:10.997219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fd782-fe3c-4e5f-9f3f-92e560990e76 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.002872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:11.003253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c229e6-1ac9-4a5d-b06e-0fff5430ed7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.004027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c229e6-1ac9-4a5d-b06e-0fff5430ed7b service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.004426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c229e6-1ac9-4a5d-b06e-0fff5430ed7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.004828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c229e6-1ac9-4a5d-b06e-0fff5430ed7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.024728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a9f84-76b2-4d63-8884-24e0db697bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.026826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9f84-76b2-4d63-8884-24e0db697bda admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.027309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9f84-76b2-4d63-8884-24e0db697bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.027628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a9f84-76b2-4d63-8884-24e0db697bda admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.028607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a9f84-76b2-4d63-8884-24e0db697bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.030758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a9f84-76b2-4d63-8884-24e0db697bda admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.062714 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 812/1630] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:10 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:11.062714 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35479c-d581-4a2f-97d3-8d50316a163e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.062714 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35479c-d581-4a2f-97d3-8d50316a163e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.062714 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35479c-d581-4a2f-97d3-8d50316a163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.084357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-db35479c-d581-4a2f-97d3-8d50316a163e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:11.085811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-db35479c-d581-4a2f-97d3-8d50316a163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:11.101878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 813/1631] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:11.104575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d7ef6-a513-42b9-96df-786521f0c3d0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.104917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d7ef6-a513-42b9-96df-786521f0c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.105208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d7ef6-a513-42b9-96df-786521f0c3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.126351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c229e6-1ac9-4a5d-b06e-0fff5430ed7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.128993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c229e6-1ac9-4a5d-b06e-0fff5430ed7b service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.133171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-935d7ef6-a513-42b9-96df-786521f0c3d0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:11.136444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-935d7ef6-a513-42b9-96df-786521f0c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:11.147241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 814/1632] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:11.148782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d7ef6-a513-42b9-96df-786521f0c3d0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:11.149660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 819/1633] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:11.152510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b47df0-ca97-4baf-b39d-274e79299243 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.152788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b47df0-ca97-4baf-b39d-274e79299243 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.153086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b47df0-ca97-4baf-b39d-274e79299243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.167382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d7ef6-a513-42b9-96df-786521f0c3d0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.174267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d759b-bf03-4754-ae91-67f72edae978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.175546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d759b-bf03-4754-ae91-67f72edae978 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.176021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d759b-bf03-4754-ae91-67f72edae978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.176529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d759b-bf03-4754-ae91-67f72edae978 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.176732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b4b47df0-ca97-4baf-b39d-274e79299243 None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:11.177620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d759b-bf03-4754-ae91-67f72edae978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.178095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b4b47df0-ca97-4baf-b39d-274e79299243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:11.180645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d759b-bf03-4754-ae91-67f72edae978 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.194268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:11.232252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 815/1634] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:11 2022] POST /identity/v3/projects => generated 403 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:11.234696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b2b1b-39d4-4786-9c02-355bb22ab0ba None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.235317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b2b1b-39d4-4786-9c02-355bb22ab0ba None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.235977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b2b1b-39d4-4786-9c02-355bb22ab0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.270922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7d2b2b1b-39d4-4786-9c02-355bb22ab0ba None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:11.272979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7d2b2b1b-39d4-4786-9c02-355bb22ab0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:11.315524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 820/1635] 10.222.0.46 () {58 vars in 1058 bytes} [Tue Jun 21 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:11.316778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b47df0-ca97-4baf-b39d-274e79299243 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:11.335436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b47df0-ca97-4baf-b39d-274e79299243 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.374647 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 816/1636] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:11.375864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b2b1b-39d4-4786-9c02-355bb22ab0ba None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:11.438052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e151853-f83c-47c1-8c86-1e429c59ccbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.439752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e151853-f83c-47c1-8c86-1e429c59ccbe admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.439752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e151853-f83c-47c1-8c86-1e429c59ccbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.440086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e151853-f83c-47c1-8c86-1e429c59ccbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.440929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e151853-f83c-47c1-8c86-1e429c59ccbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.443381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e151853-f83c-47c1-8c86-1e429c59ccbe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.462280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 821/1637] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:11.462280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e151853-f83c-47c1-8c86-1e429c59ccbe admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:11.462280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0e151853-f83c-47c1-8c86-1e429c59ccbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:11.467552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b2b1b-39d4-4786-9c02-355bb22ab0ba None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.471559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6c776-c760-4fa3-9dcf-8487cf430d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.472243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6c776-c760-4fa3-9dcf-8487cf430d99 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.472540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6c776-c760-4fa3-9dcf-8487cf430d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.472825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6c776-c760-4fa3-9dcf-8487cf430d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.478145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e151853-f83c-47c1-8c86-1e429c59ccbe admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.483716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce990ed-ae79-4ac9-90b0-5d54d0e48a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.484529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce990ed-ae79-4ac9-90b0-5d54d0e48a13 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.484916 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce990ed-ae79-4ac9-90b0-5d54d0e48a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.485676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6c776-c760-4fa3-9dcf-8487cf430d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.487198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6c776-c760-4fa3-9dcf-8487cf430d99 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.487385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce990ed-ae79-4ac9-90b0-5d54d0e48a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.499832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 817/1638] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:11.500209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6c776-c760-4fa3-9dcf-8487cf430d99 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:11.504552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce990ed-ae79-4ac9-90b0-5d54d0e48a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.507221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce990ed-ae79-4ac9-90b0-5d54d0e48a13 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.512464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6c776-c760-4fa3-9dcf-8487cf430d99 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.519890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92884f-e27f-44ca-ac62-ca2028b6e31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.519890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92884f-e27f-44ca-ac62-ca2028b6e31c admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.520380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92884f-e27f-44ca-ac62-ca2028b6e31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.520538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92884f-e27f-44ca-ac62-ca2028b6e31c admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.521291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92884f-e27f-44ca-ac62-ca2028b6e31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.523392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92884f-e27f-44ca-ac62-ca2028b6e31c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.540645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 822/1639] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:11.543311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce990ed-ae79-4ac9-90b0-5d54d0e48a13 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:11.558795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 818/1640] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:11 2022] POST /identity/v3/users => generated 308 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:11.560310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92884f-e27f-44ca-ac62-ca2028b6e31c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:11.620713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:11.657372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce990ed-ae79-4ac9-90b0-5d54d0e48a13 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.665020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38465f-2b24-4b46-b1a6-5efc7cd12625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.665987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38465f-2b24-4b46-b1a6-5efc7cd12625 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.666379 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38465f-2b24-4b46-b1a6-5efc7cd12625 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.666932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38465f-2b24-4b46-b1a6-5efc7cd12625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.685480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92884f-e27f-44ca-ac62-ca2028b6e31c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.693383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440b8c7-fb6b-4a22-bb03-87b7ebafea81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.694496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b8c7-fb6b-4a22-bb03-87b7ebafea81 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.695008 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b8c7-fb6b-4a22-bb03-87b7ebafea81 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.695624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b8c7-fb6b-4a22-bb03-87b7ebafea81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.735278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:11.758155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38465f-2b24-4b46-b1a6-5efc7cd12625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.761626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38465f-2b24-4b46-b1a6-5efc7cd12625 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.794858 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 823/1641] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:11.797289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38465f-2b24-4b46-b1a6-5efc7cd12625 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:11.826350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38465f-2b24-4b46-b1a6-5efc7cd12625 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.842832 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f1739-a1bf-46fa-8930-22ba9594f90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.842832 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f1739-a1bf-46fa-8930-22ba9594f90f service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.842832 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f1739-a1bf-46fa-8930-22ba9594f90f service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.842832 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f1739-a1bf-46fa-8930-22ba9594f90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.845104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440b8c7-fb6b-4a22-bb03-87b7ebafea81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.846955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440b8c7-fb6b-4a22-bb03-87b7ebafea81 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.874676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f1739-a1bf-46fa-8930-22ba9594f90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.877301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 819/1642] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:11.877629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f1739-a1bf-46fa-8930-22ba9594f90f service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.878797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440b8c7-fb6b-4a22-bb03-87b7ebafea81 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:11.913700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440b8c7-fb6b-4a22-bb03-87b7ebafea81 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.918216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 824/1643] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:11.920052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f1739-a1bf-46fa-8930-22ba9594f90f service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:11.934878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821ffd7-8070-4806-b2d8-01526822f5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.934878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821ffd7-8070-4806-b2d8-01526822f5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.934878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821ffd7-8070-4806-b2d8-01526822f5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.934878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821ffd7-8070-4806-b2d8-01526822f5a9 admin admin] PATH_INFO: `/v3/projects/2730edb408bd4634b6941d76cf6a6dcc/users/010fea290b59432296c23831dc9284e2/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.954140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f1739-a1bf-46fa-8930-22ba9594f90f service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:11.968829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821ffd7-8070-4806-b2d8-01526822f5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2730edb408bd4634b6941d76cf6a6dcc, user_id=010fea290b59432296c23831dc9284e2, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.971973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821ffd7-8070-4806-b2d8-01526822f5a9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:11.972909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b038bc1-2a05-400a-aa19-183edf5c7705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:11.973813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b038bc1-2a05-400a-aa19-183edf5c7705 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:11.976343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b038bc1-2a05-400a-aa19-183edf5c7705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:11.976343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b038bc1-2a05-400a-aa19-183edf5c7705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:11.979229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b038bc1-2a05-400a-aa19-183edf5c7705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:11.981551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b038bc1-2a05-400a-aa19-183edf5c7705 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:12.010348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 820/1644] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:11 2022] PUT /identity/v3/projects/2730edb408bd4634b6941d76cf6a6dcc/users/010fea290b59432296c23831dc9284e2/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:12.013612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 825/1645] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:12.017307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821ffd7-8070-4806-b2d8-01526822f5a9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:12.039323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b038bc1-2a05-400a-aa19-183edf5c7705 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:12.086611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b038bc1-2a05-400a-aa19-183edf5c7705 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:12.208483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821ffd7-8070-4806-b2d8-01526822f5a9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:12.218160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b542204-7b7c-460f-8781-58910dffaa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:12.219748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b542204-7b7c-460f-8781-58910dffaa12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:12.220399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b542204-7b7c-460f-8781-58910dffaa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:12.220942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b542204-7b7c-460f-8781-58910dffaa12 admin admin] PATH_INFO: `/v3/projects/4d1dfda86d9e4de1b92dbb103c071df5/users/9fd20ee75c664679a371e746a8f4bf76/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:12.221951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd99f0-54c1-457a-91b7-46af34b56e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:12.225128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd99f0-54c1-457a-91b7-46af34b56e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:12.225774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd99f0-54c1-457a-91b7-46af34b56e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:12.228098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd99f0-54c1-457a-91b7-46af34b56e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:12.231663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd99f0-54c1-457a-91b7-46af34b56e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:12.235405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd99f0-54c1-457a-91b7-46af34b56e4c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:12.254076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b542204-7b7c-460f-8781-58910dffaa12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1dfda86d9e4de1b92dbb103c071df5, user_id=9fd20ee75c664679a371e746a8f4bf76, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:12.257572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b542204-7b7c-460f-8781-58910dffaa12 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:12.300631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 821/1646] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:12.309405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd99f0-54c1-457a-91b7-46af34b56e4c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:12.315764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 826/1647] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:12 2022] PUT /identity/v3/projects/4d1dfda86d9e4de1b92dbb103c071df5/users/9fd20ee75c664679a371e746a8f4bf76/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:12.320140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b542204-7b7c-460f-8781-58910dffaa12 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:12.349863 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd99f0-54c1-457a-91b7-46af34b56e4c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:12.440986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:12.508381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16374a7-2814-4ea2-9efb-a8f71dad7449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:12.509312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16374a7-2814-4ea2-9efb-a8f71dad7449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:12.510261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16374a7-2814-4ea2-9efb-a8f71dad7449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:12.510571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16374a7-2814-4ea2-9efb-a8f71dad7449 admin admin] PATH_INFO: `/v3/projects/2730edb408bd4634b6941d76cf6a6dcc/users/010fea290b59432296c23831dc9284e2/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:12.514788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16374a7-2814-4ea2-9efb-a8f71dad7449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2730edb408bd4634b6941d76cf6a6dcc, user_id=010fea290b59432296c23831dc9284e2, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:12.518103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16374a7-2814-4ea2-9efb-a8f71dad7449 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:12.549660 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 822/1648] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:12 2022] PUT /identity/v3/projects/2730edb408bd4634b6941d76cf6a6dcc/users/010fea290b59432296c23831dc9284e2/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:59:12.579092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f8b47-31ed-4240-a643-20ad3f6b4eb1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:12.579474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f8b47-31ed-4240-a643-20ad3f6b4eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:12.579712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f8b47-31ed-4240-a643-20ad3f6b4eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:12.637559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b542204-7b7c-460f-8781-58910dffaa12 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:12.656439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8c7f8b47-31ed-4240-a643-20ad3f6b4eb1 None None] MFA Rules not processed for user `010fea290b59432296c23831dc9284e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:12.656439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8c7f8b47-31ed-4240-a643-20ad3f6b4eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:12.867722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:12.904064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2578e3-70a2-4fcd-bd87-8eb4d4db768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:12.905200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2578e3-70a2-4fcd-bd87-8eb4d4db768d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:12.905200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2578e3-70a2-4fcd-bd87-8eb4d4db768d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:12.905533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2578e3-70a2-4fcd-bd87-8eb4d4db768d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:12.906112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2578e3-70a2-4fcd-bd87-8eb4d4db768d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:12.908006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2578e3-70a2-4fcd-bd87-8eb4d4db768d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:12.930260 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 827/1649] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 611 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:12.936615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2578e3-70a2-4fcd-bd87-8eb4d4db768d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:12.957219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2578e3-70a2-4fcd-bd87-8eb4d4db768d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:12.975870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5119408-ddcc-472c-8ad7-ff2562d3582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:12.979856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5119408-ddcc-472c-8ad7-ff2562d3582b admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:12.980402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5119408-ddcc-472c-8ad7-ff2562d3582b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:12.980882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5119408-ddcc-472c-8ad7-ff2562d3582b admin admin] PATH_INFO: `/v3/projects/4d1dfda86d9e4de1b92dbb103c071df5/users/9fd20ee75c664679a371e746a8f4bf76/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:12.994519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5119408-ddcc-472c-8ad7-ff2562d3582b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1dfda86d9e4de1b92dbb103c071df5, user_id=9fd20ee75c664679a371e746a8f4bf76, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:13.000886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 823/1650] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:13.029824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5119408-ddcc-472c-8ad7-ff2562d3582b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:13.037438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f8b47-31ed-4240-a643-20ad3f6b4eb1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:13.082474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 828/1651] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:12 2022] PUT /identity/v3/projects/4d1dfda86d9e4de1b92dbb103c071df5/users/9fd20ee75c664679a371e746a8f4bf76/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:59:13.085543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b73e9a-a798-4c59-bf3b-41efcef9b212 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:13.091980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b73e9a-a798-4c59-bf3b-41efcef9b212 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:13.093609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b73e9a-a798-4c59-bf3b-41efcef9b212 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:13.098502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 829/1652] 10.222.0.46 () {54 vars in 912 bytes} [Tue Jun 21 15:59:13 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:59:13.101312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395857e2-ae90-4273-9095-b7154dfe8287 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:13.102024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395857e2-ae90-4273-9095-b7154dfe8287 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:13.102657 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395857e2-ae90-4273-9095-b7154dfe8287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:13.203865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-395857e2-ae90-4273-9095-b7154dfe8287 None None] MFA Rules not processed for user `9fd20ee75c664679a371e746a8f4bf76`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:13.206452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-395857e2-ae90-4273-9095-b7154dfe8287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:13.220148 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f8b47-31ed-4240-a643-20ad3f6b4eb1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:13.320920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06669-8856-48a9-a002-480b459f0c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:13.321240 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06669-8856-48a9-a002-480b459f0c40 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:13.321676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06669-8856-48a9-a002-480b459f0c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:13.324727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06669-8856-48a9-a002-480b459f0c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:13.375241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:13.403200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 830/1653] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:13 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:13.403200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aca64-c366-45d1-a6ae-cec32356a34b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:13.403200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aca64-c366-45d1-a6ae-cec32356a34b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:13.403200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aca64-c366-45d1-a6ae-cec32356a34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:13.466371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-176aca64-c366-45d1-a6ae-cec32356a34b None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:13.468635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-176aca64-c366-45d1-a6ae-cec32356a34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:13.538407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06669-8856-48a9-a002-480b459f0c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:13.542257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06669-8856-48a9-a002-480b459f0c40 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:13.602901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 824/1654] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:59:13.608177 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06669-8856-48a9-a002-480b459f0c40 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:13.662488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 831/1655] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 15:59:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:13.665740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9511cd-c814-43d6-82a3-2146aab45481 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:13.667328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9511cd-c814-43d6-82a3-2146aab45481 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:13.667877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9511cd-c814-43d6-82a3-2146aab45481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:13.673761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06669-8856-48a9-a002-480b459f0c40 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:13.702224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c601512-25ab-49af-8814-3a5517819de0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:13.703594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c601512-25ab-49af-8814-3a5517819de0 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:13.706417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c601512-25ab-49af-8814-3a5517819de0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:13.710510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c601512-25ab-49af-8814-3a5517819de0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:13.735291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0d9511cd-c814-43d6-82a3-2146aab45481 None None] MFA Rules not processed for user `9750c692f9ef4afa8a897747b5c11a81`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:13.738411 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0d9511cd-c814-43d6-82a3-2146aab45481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:13.748981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c601512-25ab-49af-8814-3a5517819de0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:13.751622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c601512-25ab-49af-8814-3a5517819de0 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:13.789013 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 825/1656] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:13 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:13.827841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:13.874659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c601512-25ab-49af-8814-3a5517819de0 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:13.918646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c601512-25ab-49af-8814-3a5517819de0 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:13.947201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39678b-c20f-4230-aa01-99e5a37b6d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:13.952968 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39678b-c20f-4230-aa01-99e5a37b6d9e service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:13.953389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39678b-c20f-4230-aa01-99e5a37b6d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:13.953688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39678b-c20f-4230-aa01-99e5a37b6d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:13.956422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 832/1657] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:13.964078 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9511cd-c814-43d6-82a3-2146aab45481 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:13.970937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39678b-c20f-4230-aa01-99e5a37b6d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:13.972640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39678b-c20f-4230-aa01-99e5a37b6d9e service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:13.989231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 826/1658] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:59:14.189705 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9511cd-c814-43d6-82a3-2146aab45481 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:14.203454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca1089-dada-49d2-827c-8d657759e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:14.204157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca1089-dada-49d2-827c-8d657759e329 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:14.204457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca1089-dada-49d2-827c-8d657759e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:14.205400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca1089-dada-49d2-827c-8d657759e329 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:14.206160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca1089-dada-49d2-827c-8d657759e329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:14.208324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca1089-dada-49d2-827c-8d657759e329 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:14.262866 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 833/1659] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:13 2022] POST /identity/v3/projects => generated 405 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:14.263548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39678b-c20f-4230-aa01-99e5a37b6d9e service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:14.287795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39678b-c20f-4230-aa01-99e5a37b6d9e service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:14.350424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca1089-dada-49d2-827c-8d657759e329 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:14.501427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68688488-51bb-4cb2-84f3-6ce9fd9014fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:14.503394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68688488-51bb-4cb2-84f3-6ce9fd9014fe admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:14.505385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68688488-51bb-4cb2-84f3-6ce9fd9014fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:14.506425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68688488-51bb-4cb2-84f3-6ce9fd9014fe admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:14.507895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68688488-51bb-4cb2-84f3-6ce9fd9014fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:14.513819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68688488-51bb-4cb2-84f3-6ce9fd9014fe admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:14.610521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca1089-dada-49d2-827c-8d657759e329 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:14.615203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 827/1660] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:14 2022] POST /identity/v3/users => generated 309 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:14.620955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:14.621933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:14.622160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:14.622495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] PATH_INFO: `/v3/users/e3dde213de504589bf59ec0b410a693d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:14.623276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68688488-51bb-4cb2-84f3-6ce9fd9014fe admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:14.626224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3dde213de504589bf59ec0b410a693d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:14.630023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:14.667006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68688488-51bb-4cb2-84f3-6ce9fd9014fe admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:14.686952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae419f-fa2f-410b-b4c7-79be7b2b0f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:14.688487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae419f-fa2f-410b-b4c7-79be7b2b0f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:14.689178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae419f-fa2f-410b-b4c7-79be7b2b0f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:14.689864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae419f-fa2f-410b-b4c7-79be7b2b0f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:14.692026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae419f-fa2f-410b-b4c7-79be7b2b0f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:14.701051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae419f-fa2f-410b-b4c7-79be7b2b0f45 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:14.740017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 828/1661] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:59:14.741832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae419f-fa2f-410b-b4c7-79be7b2b0f45 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:14.754262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3dde213de504589bf59ec0b410a693d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:14.792619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3dde213de504589bf59ec0b410a693d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:14.798195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:14.821636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3dde213de504589bf59ec0b410a693d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:14.825594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3dde213de504589bf59ec0b410a693d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:14.856549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3dde213de504589bf59ec0b410a693d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:14.865453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae419f-fa2f-410b-b4c7-79be7b2b0f45 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:14.872709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986284a-8513-4d83-81bb-4dd9379738b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:14.873280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986284a-8513-4d83-81bb-4dd9379738b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:14.873683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986284a-8513-4d83-81bb-4dd9379738b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:14.873975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986284a-8513-4d83-81bb-4dd9379738b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:14.877392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4986284a-8513-4d83-81bb-4dd9379738b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:14.912086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 834/1662] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:14 2022] DELETE /identity/v3/users/e3dde213de504589bf59ec0b410a693d => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:14.917910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:14.926079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:14.926320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:14.966551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986284a-8513-4d83-81bb-4dd9379738b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:14.968178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986284a-8513-4d83-81bb-4dd9379738b5 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:14.981233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 829/1663] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:14.982672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e032336-fdf9-46ed-ae04-8f3163a4eecb None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:14.982980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e032336-fdf9-46ed-ae04-8f3163a4eecb None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:14.983362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e032336-fdf9-46ed-ae04-8f3163a4eecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:15.031885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0e032336-fdf9-46ed-ae04-8f3163a4eecb None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:15.034543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0e032336-fdf9-46ed-ae04-8f3163a4eecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:15.224546 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fff7e-67f4-443a-8f22-619e79e42c07 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:15.235144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb20f1-88b7-41ed-8eca-71a54b9bce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:15.236950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb20f1-88b7-41ed-8eca-71a54b9bce0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:15.237308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb20f1-88b7-41ed-8eca-71a54b9bce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:15.237647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb20f1-88b7-41ed-8eca-71a54b9bce0f admin admin] PATH_INFO: `/v3/projects/2fbd886823354655ab3b15d646ced92e/users/1aea8e8e7f2d46168c2942d8e2bbb03b/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:15.258676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 830/1664] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:15.282896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e032336-fdf9-46ed-ae04-8f3163a4eecb None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:15.288175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0e032336-fdf9-46ed-ae04-8f3163a4eecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:15.327329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb20f1-88b7-41ed-8eca-71a54b9bce0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbd886823354655ab3b15d646ced92e, user_id=1aea8e8e7f2d46168c2942d8e2bbb03b, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:15.364701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb20f1-88b7-41ed-8eca-71a54b9bce0f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:15.424216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 835/1665] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:14 2022] PUT /identity/v3/projects/2fbd886823354655ab3b15d646ced92e/users/1aea8e8e7f2d46168c2942d8e2bbb03b/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:15.429067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb20f1-88b7-41ed-8eca-71a54b9bce0f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:15.506847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e032336-fdf9-46ed-ae04-8f3163a4eecb None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:15.666191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb20f1-88b7-41ed-8eca-71a54b9bce0f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:15.684203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec083d3-dfda-472d-b184-9e99358c015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:15.684539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c692f6b-cf80-4600-b2c2-ecdaa596c8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:15.684916 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec083d3-dfda-472d-b184-9e99358c015b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:15.685207 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec083d3-dfda-472d-b184-9e99358c015b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:15.685485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec083d3-dfda-472d-b184-9e99358c015b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:15.685666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692f6b-cf80-4600-b2c2-ecdaa596c8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:15.686143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692f6b-cf80-4600-b2c2-ecdaa596c8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:15.686298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec083d3-dfda-472d-b184-9e99358c015b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:15.686604 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692f6b-cf80-4600-b2c2-ecdaa596c8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:15.701454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec083d3-dfda-472d-b184-9e99358c015b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:15.725114 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c692f6b-cf80-4600-b2c2-ecdaa596c8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:15.727832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c692f6b-cf80-4600-b2c2-ecdaa596c8f0 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:15.736216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 836/1666] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:59:15.736216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec083d3-dfda-472d-b184-9e99358c015b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:15.748679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4ec083d3-dfda-472d-b184-9e99358c015b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:15.790115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 831/1667] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:15.792431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c692f6b-cf80-4600-b2c2-ecdaa596c8f0 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:15.801976 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec083d3-dfda-472d-b184-9e99358c015b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:15.821425 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:15.823508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:15.823822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:15.824111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] PATH_INFO: `/v3/users/f217871fca5943ff9888b5e318d86296` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:15.828964 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c692f6b-cf80-4600-b2c2-ecdaa596c8f0 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:15.833754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f217871fca5943ff9888b5e318d86296)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:15.838412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:15.842658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924631-5ee2-4ca4-9eb5-42752ff0f289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:15.851853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924631-5ee2-4ca4-9eb5-42752ff0f289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:15.852502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924631-5ee2-4ca4-9eb5-42752ff0f289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:15.852995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924631-5ee2-4ca4-9eb5-42752ff0f289 admin admin] PATH_INFO: `/v3/projects/2fbd886823354655ab3b15d646ced92e/users/1aea8e8e7f2d46168c2942d8e2bbb03b/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:15.867868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924631-5ee2-4ca4-9eb5-42752ff0f289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbd886823354655ab3b15d646ced92e, user_id=1aea8e8e7f2d46168c2942d8e2bbb03b, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:15.882764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924631-5ee2-4ca4-9eb5-42752ff0f289 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:15.937327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 832/1668] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:15 2022] PUT /identity/v3/projects/2fbd886823354655ab3b15d646ced92e/users/1aea8e8e7f2d46168c2942d8e2bbb03b/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:16.066349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f217871fca5943ff9888b5e318d86296'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:16.106263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:16.126595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f217871fca5943ff9888b5e318d86296'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:16.155903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f217871fca5943ff9888b5e318d86296'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:16.156957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f217871fca5943ff9888b5e318d86296'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:16.191230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f217871fca5943ff9888b5e318d86296'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:16.236635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 837/1669] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:15 2022] DELETE /identity/v3/users/f217871fca5943ff9888b5e318d86296 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:16.245373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc02de-c89c-4296-9256-cdec558e03d8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:16.245895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc02de-c89c-4296-9256-cdec558e03d8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:16.246575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc02de-c89c-4296-9256-cdec558e03d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:16.314381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6adc02de-c89c-4296-9256-cdec558e03d8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:16.324827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6adc02de-c89c-4296-9256-cdec558e03d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:16.389218 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:16.539328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 833/1670] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:16.652824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:16.655776 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:16.998286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27f2f5-8f4d-43e5-808f-44f563efd106 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:17.012507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c358da4-6a6b-40c5-b55f-78a98f7b3e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:17.014420 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c358da4-6a6b-40c5-b55f-78a98f7b3e75 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:17.015769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c358da4-6a6b-40c5-b55f-78a98f7b3e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:17.016388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c358da4-6a6b-40c5-b55f-78a98f7b3e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:17.044273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c358da4-6a6b-40c5-b55f-78a98f7b3e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:17.049971 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c358da4-6a6b-40c5-b55f-78a98f7b3e75 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:17.071751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 838/1671] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:17.910235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc02de-c89c-4296-9256-cdec558e03d8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:17.915750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6adc02de-c89c-4296-9256-cdec558e03d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:17.960330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc02de-c89c-4296-9256-cdec558e03d8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:17.981859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:17.981859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:17.981859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:17.981859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] PATH_INFO: `/v3/projects/ce60525d6df54630b29d1f8d6c54c68d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:17.994900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce60525d6df54630b29d1f8d6c54c68d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:17.995045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c358da4-6a6b-40c5-b55f-78a98f7b3e75 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:17.996234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6c358da4-6a6b-40c5-b55f-78a98f7b3e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:17.997072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:18.020507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c358da4-6a6b-40c5-b55f-78a98f7b3e75 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:18.042685 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:18.044483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:18.044986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:18.045489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] PATH_INFO: `/v3/users/0816329415384fffbe4b4d69b768d8c5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:18.048750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0816329415384fffbe4b4d69b768d8c5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:18.053438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:18.104060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce60525d6df54630b29d1f8d6c54c68d', 'request_id': 'req-c97394fc-ad51-45d2-811d-d9bfa774938b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.120872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce60525d6df54630b29d1f8d6c54c68d', 'request_id': 'req-c97394fc-ad51-45d2-811d-d9bfa774938b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.148049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce60525d6df54630b29d1f8d6c54c68d', 'request_id': 'req-c97394fc-ad51-45d2-811d-d9bfa774938b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.168798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] The token cache is being invalidate because project ce60525d6df54630b29d1f8d6c54c68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:18.169084 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.170791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c97394fc-ad51-45d2-811d-d9bfa774938b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.176361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 834/1672] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:17 2022] DELETE /identity/v3/projects/ce60525d6df54630b29d1f8d6c54c68d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:18.184246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5cd63-aa24-48e9-905a-7428abe81467 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:18.185085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5cd63-aa24-48e9-905a-7428abe81467 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:18.185953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5cd63-aa24-48e9-905a-7428abe81467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:18.194837 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0816329415384fffbe4b4d69b768d8c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.231744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0816329415384fffbe4b4d69b768d8c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.257404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0816329415384fffbe4b4d69b768d8c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.257649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-39b5cd63-aa24-48e9-905a-7428abe81467 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:18.258879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0816329415384fffbe4b4d69b768d8c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.263733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-39b5cd63-aa24-48e9-905a-7428abe81467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:18.274879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f8822af-9da9-4bc1-bc3a-c6d9f954a117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0816329415384fffbe4b4d69b768d8c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.302111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 839/1673] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:17 2022] DELETE /identity/v3/users/0816329415384fffbe4b4d69b768d8c5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:18.306702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebbbb-d0dd-4333-ad8e-94ad5b084f6b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:18.306972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebbbb-d0dd-4333-ad8e-94ad5b084f6b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:18.307296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebbbb-d0dd-4333-ad8e-94ad5b084f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:18.346069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f40ebbbb-d0dd-4333-ad8e-94ad5b084f6b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:18.348488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f40ebbbb-d0dd-4333-ad8e-94ad5b084f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:18.511296 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 835/1674] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:59:18.511296 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5cd63-aa24-48e9-905a-7428abe81467 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:18.520486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:18.527424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-39b5cd63-aa24-48e9-905a-7428abe81467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:18.605664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 840/1675] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:59:18.605943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5cd63-aa24-48e9-905a-7428abe81467 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:18.606115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cdccf-938a-4655-8239-8310722e777d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:18.606115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cdccf-938a-4655-8239-8310722e777d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:18.606115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cdccf-938a-4655-8239-8310722e777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:18.617551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:18.619643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:18.620185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:18.620706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] PATH_INFO: `/v3/projects/1d58e3220f7e4cfabbd3279745fd1a38` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:18.629776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d58e3220f7e4cfabbd3279745fd1a38)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:18.639581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:18.657671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a55cdccf-938a-4655-8239-8310722e777d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:18.659959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a55cdccf-938a-4655-8239-8310722e777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:18.706451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 841/1676] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:18.708264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cdccf-938a-4655-8239-8310722e777d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:18.711011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a55cdccf-938a-4655-8239-8310722e777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:18.796186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:18.857921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d58e3220f7e4cfabbd3279745fd1a38', 'request_id': 'req-e52ba192-97d4-4580-be3a-d8939e71ac63'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.889876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cdccf-938a-4655-8239-8310722e777d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:18.895913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d58e3220f7e4cfabbd3279745fd1a38', 'request_id': 'req-e52ba192-97d4-4580-be3a-d8939e71ac63'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.946172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d58e3220f7e4cfabbd3279745fd1a38', 'request_id': 'req-e52ba192-97d4-4580-be3a-d8939e71ac63'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.973230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] The token cache is being invalidate because project 1d58e3220f7e4cfabbd3279745fd1a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:18.974587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.975864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:18.979753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 836/1677] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:18 2022] DELETE /identity/v3/projects/1d58e3220f7e4cfabbd3279745fd1a38 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:18.981421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:18.985246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:19.006107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e0375-ee79-466e-a044-c5fc5115ae6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:19.006828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0375-ee79-466e-a044-c5fc5115ae6a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:19.007341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0375-ee79-466e-a044-c5fc5115ae6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:19.007512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0375-ee79-466e-a044-c5fc5115ae6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:19.011647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-441e0375-ee79-466e-a044-c5fc5115ae6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:19.229851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba192-97d4-4580-be3a-d8939e71ac63 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:19.246314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac2354-5853-4f02-84ba-81472fb47164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:19.253052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac2354-5853-4f02-84ba-81472fb47164 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:19.255585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac2354-5853-4f02-84ba-81472fb47164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:19.256103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac2354-5853-4f02-84ba-81472fb47164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:19.264082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac2354-5853-4f02-84ba-81472fb47164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:19.264634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac2354-5853-4f02-84ba-81472fb47164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:19.269238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac2354-5853-4f02-84ba-81472fb47164 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:19.284607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e0375-ee79-466e-a044-c5fc5115ae6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:19.287143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e0375-ee79-466e-a044-c5fc5115ae6a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:19.314975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 837/1678] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:19.314975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac2354-5853-4f02-84ba-81472fb47164 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:19.317645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a1ac2354-5853-4f02-84ba-81472fb47164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:19.333886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 842/1679] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:19.335247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e0375-ee79-466e-a044-c5fc5115ae6a service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:19.361567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e0375-ee79-466e-a044-c5fc5115ae6a service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:19.364339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac2354-5853-4f02-84ba-81472fb47164 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:19.376517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:19.378412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:19.378897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:19.381990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedf2d2-8419-4550-b751-aa373e12d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:19.383515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] PATH_INFO: `/v3/users/9fd20ee75c664679a371e746a8f4bf76` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:19.386875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedf2d2-8419-4550-b751-aa373e12d554 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:19.389771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedf2d2-8419-4550-b751-aa373e12d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:19.392399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedf2d2-8419-4550-b751-aa373e12d554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:19.394726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedf2d2-8419-4550-b751-aa373e12d554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:19.396978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd20ee75c664679a371e746a8f4bf76)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:19.399585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: WARNING py.warnings [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:59:19.399585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: warnings.warn(msg) Jun 21 15:59:19.399585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: Jun 21 15:59:19.404132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:19.406886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedf2d2-8419-4550-b751-aa373e12d554 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:19.547579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 843/1680] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:19 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:19.559061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedf2d2-8419-4550-b751-aa373e12d554 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:19.730681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:19.750476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd20ee75c664679a371e746a8f4bf76'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:19.854749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd20ee75c664679a371e746a8f4bf76'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:19.861240 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd20ee75c664679a371e746a8f4bf76'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:19.896692 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedf2d2-8419-4550-b751-aa373e12d554 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:19.928430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd20ee75c664679a371e746a8f4bf76'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:19.930327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd20ee75c664679a371e746a8f4bf76'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:19.932380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b941c-7c87-4d5d-88ef-9faf4fedfe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:19.933477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b941c-7c87-4d5d-88ef-9faf4fedfe94 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:19.933922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b941c-7c87-4d5d-88ef-9faf4fedfe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:19.934350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b941c-7c87-4d5d-88ef-9faf4fedfe94 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:19.935522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b941c-7c87-4d5d-88ef-9faf4fedfe94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:19.963888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b941c-7c87-4d5d-88ef-9faf4fedfe94 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:19.983749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 838/1681] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:19 2022] DELETE /identity/v3/users/9fd20ee75c664679a371e746a8f4bf76 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:20.088758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 844/1682] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:19 2022] POST /identity/v3/users => generated 287 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:20.094832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:20.101719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:20.234993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:20.372805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e27be-b725-4605-a648-bbc42954d845 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:20.398113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab76cbb-1394-4abb-aec4-eb24c499a795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:20.400657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76cbb-1394-4abb-aec4-eb24c499a795 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:20.400657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76cbb-1394-4abb-aec4-eb24c499a795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:20.401066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab76cbb-1394-4abb-aec4-eb24c499a795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:20.403817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab76cbb-1394-4abb-aec4-eb24c499a795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:20.411099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab76cbb-1394-4abb-aec4-eb24c499a795 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:20.466143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 839/1683] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:20.466967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b941c-7c87-4d5d-88ef-9faf4fedfe94 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:20.482446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b941c-7c87-4d5d-88ef-9faf4fedfe94 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:20.498592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b17494-af1f-459f-bac1-f9935d03b899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:20.499315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b17494-af1f-459f-bac1-f9935d03b899 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:20.499552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b17494-af1f-459f-bac1-f9935d03b899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:20.500415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b17494-af1f-459f-bac1-f9935d03b899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:20.501025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b17494-af1f-459f-bac1-f9935d03b899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:20.508518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b17494-af1f-459f-bac1-f9935d03b899 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:20.523377 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bad3a-fb49-4922-b44c-3de8faf5a8a2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:20.523678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bad3a-fb49-4922-b44c-3de8faf5a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:20.524044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bad3a-fb49-4922-b44c-3de8faf5a8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:20.585648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 845/1684] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:20.586702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b17494-af1f-459f-bac1-f9935d03b899 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:20.624206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-403bad3a-fb49-4922-b44c-3de8faf5a8a2 None None] MFA Rules not processed for user `1aea8e8e7f2d46168c2942d8e2bbb03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:20.625509 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-403bad3a-fb49-4922-b44c-3de8faf5a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:20.654167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b17494-af1f-459f-bac1-f9935d03b899 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:20.690235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23c248-1dd7-4523-97da-255e9bf7485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:20.691906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23c248-1dd7-4523-97da-255e9bf7485e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:20.692680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23c248-1dd7-4523-97da-255e9bf7485e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:20.703713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23c248-1dd7-4523-97da-255e9bf7485e admin admin] PATH_INFO: `/v3/projects/04f39f1579864470a811c8578e3849bd/users/315f396f4450487185bf1d67cdbc2de1/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:20.811600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23c248-1dd7-4523-97da-255e9bf7485e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f39f1579864470a811c8578e3849bd, user_id=315f396f4450487185bf1d67cdbc2de1, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:20.832572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23c248-1dd7-4523-97da-255e9bf7485e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:20.887982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 846/1685] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:20 2022] PUT /identity/v3/projects/04f39f1579864470a811c8578e3849bd/users/315f396f4450487185bf1d67cdbc2de1/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:20.911826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc358-ccbf-4a05-9c03-c38a39b62ab0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:20.912636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc358-ccbf-4a05-9c03-c38a39b62ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:20.913132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc358-ccbf-4a05-9c03-c38a39b62ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:20.965986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 840/1686] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:21.028722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-818bc358-ccbf-4a05-9c03-c38a39b62ab0 None None] MFA Rules not processed for user `315f396f4450487185bf1d67cdbc2de1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:21.030504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-818bc358-ccbf-4a05-9c03-c38a39b62ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:21.159792 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 847/1687] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:21.166566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bad3a-fb49-4922-b44c-3de8faf5a8a2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:21.182531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bad3a-fb49-4922-b44c-3de8faf5a8a2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:21.356413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c31af-a4ca-429d-825c-965a6512a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:21.357375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c31af-a4ca-429d-825c-965a6512a45d admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:21.358162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c31af-a4ca-429d-825c-965a6512a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:21.358385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c31af-a4ca-429d-825c-965a6512a45d admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:21.359767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c31af-a4ca-429d-825c-965a6512a45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:21.363537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c31af-a4ca-429d-825c-965a6512a45d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:21.420175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 841/1688] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:21 2022] POST /identity/v3/projects => generated 371 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:21.426592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bc358-ccbf-4a05-9c03-c38a39b62ab0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:21.457925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bc358-ccbf-4a05-9c03-c38a39b62ab0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:21.809016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d059f-726d-45e4-9c07-d27a72b7fee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:21.813977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d059f-726d-45e4-9c07-d27a72b7fee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:21.814622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d059f-726d-45e4-9c07-d27a72b7fee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:21.815131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d059f-726d-45e4-9c07-d27a72b7fee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:21.816532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d059f-726d-45e4-9c07-d27a72b7fee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:21.828079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d059f-726d-45e4-9c07-d27a72b7fee5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:21.920261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 848/1689] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:21 2022] POST /identity/v3/users => generated 292 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:21.927803 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c31af-a4ca-429d-825c-965a6512a45d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:21.981371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c31af-a4ca-429d-825c-965a6512a45d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:22.027505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25806074-1e6a-4aac-9a20-9cd904a696db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:22.032734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25806074-1e6a-4aac-9a20-9cd904a696db admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:22.033923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25806074-1e6a-4aac-9a20-9cd904a696db admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:22.034918 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25806074-1e6a-4aac-9a20-9cd904a696db admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:22.037709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25806074-1e6a-4aac-9a20-9cd904a696db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:22.045697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25806074-1e6a-4aac-9a20-9cd904a696db admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:22.110611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d059f-726d-45e4-9c07-d27a72b7fee5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:22.123032 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e30d059f-726d-45e4-9c07-d27a72b7fee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:22.130960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 842/1690] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:22.139097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25806074-1e6a-4aac-9a20-9cd904a696db admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:22.170433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:22.207729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25806074-1e6a-4aac-9a20-9cd904a696db admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:22.226010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d059f-726d-45e4-9c07-d27a72b7fee5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:22.237434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6afd67-712b-4777-9a23-8e3d3cfbe04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:22.238648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6afd67-712b-4777-9a23-8e3d3cfbe04e admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:22.241445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:22.242243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6afd67-712b-4777-9a23-8e3d3cfbe04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:22.243674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6afd67-712b-4777-9a23-8e3d3cfbe04e admin admin] PATH_INFO: `/v3/projects/134159ea75e7494c8af09f2055fde288/users/b603c9d227ab4cce84aa8c6c7224317f/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:22.244588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:22.245398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:22.246838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] PATH_INFO: `/v3/projects/9d28b70e101744fca6ac45e676b8e721` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:22.251454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d28b70e101744fca6ac45e676b8e721)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:22.254890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:59:22.254890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: warnings.warn(msg) Jun 21 15:59:22.254890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: Jun 21 15:59:22.256668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:22.320339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6afd67-712b-4777-9a23-8e3d3cfbe04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=134159ea75e7494c8af09f2055fde288, user_id=b603c9d227ab4cce84aa8c6c7224317f, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:22.328567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6afd67-712b-4777-9a23-8e3d3cfbe04e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:22.354861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:22.361529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 843/1691] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:22 2022] PUT /identity/v3/projects/134159ea75e7494c8af09f2055fde288/users/b603c9d227ab4cce84aa8c6c7224317f/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:22.367926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6afd67-712b-4777-9a23-8e3d3cfbe04e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:22.441964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d28b70e101744fca6ac45e676b8e721', 'request_id': 'req-9f2bdec5-e303-4892-80d9-f0e55f033c41'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:22.466919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d28b70e101744fca6ac45e676b8e721', 'request_id': 'req-9f2bdec5-e303-4892-80d9-f0e55f033c41'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:22.480942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d28b70e101744fca6ac45e676b8e721', 'request_id': 'req-9f2bdec5-e303-4892-80d9-f0e55f033c41'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:22.510232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] The token cache is being invalidate because project 9d28b70e101744fca6ac45e676b8e721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:22.510538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:22.513524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f2bdec5-e303-4892-80d9-f0e55f033c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:22.527970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 849/1692] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:22 2022] DELETE /identity/v3/projects/9d28b70e101744fca6ac45e676b8e721 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:22.536693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0634-3ca3-4f72-ae13-51d040f89b0b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:22.537128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0634-3ca3-4f72-ae13-51d040f89b0b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:22.538890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0634-3ca3-4f72-ae13-51d040f89b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:22.593333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f61b0634-3ca3-4f72-ae13-51d040f89b0b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:22.594672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f61b0634-3ca3-4f72-ae13-51d040f89b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:22.605606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6afd67-712b-4777-9a23-8e3d3cfbe04e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:22.817245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aa889-f2f2-4b3b-a3a8-f23cec5114f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:22.818227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aa889-f2f2-4b3b-a3a8-f23cec5114f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:22.831275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 850/1693] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:59:22.831615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aa889-f2f2-4b3b-a3a8-f23cec5114f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:22.831968 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aa889-f2f2-4b3b-a3a8-f23cec5114f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:22.834860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b9210-261d-4824-9ceb-407499a5ab1c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:22.835181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aa889-f2f2-4b3b-a3a8-f23cec5114f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:22.835642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b9210-261d-4824-9ceb-407499a5ab1c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:22.835936 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b9210-261d-4824-9ceb-407499a5ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:22.841665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aa889-f2f2-4b3b-a3a8-f23cec5114f5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:22.882317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 844/1694] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 511 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:22.886455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aa889-f2f2-4b3b-a3a8-f23cec5114f5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:22.906314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0c3aa889-f2f2-4b3b-a3a8-f23cec5114f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:22.906882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ee1b9210-261d-4824-9ceb-407499a5ab1c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:22.916156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ee1b9210-261d-4824-9ceb-407499a5ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:22.947802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 851/1695] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:22.954130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b9210-261d-4824-9ceb-407499a5ab1c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:22.968390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aa889-f2f2-4b3b-a3a8-f23cec5114f5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:22.977303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c4b9a-f88f-4b3c-b410-caf9fd91e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:22.980660 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c4b9a-f88f-4b3c-b410-caf9fd91e0be admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:22.984650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c4b9a-f88f-4b3c-b410-caf9fd91e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:22.985242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c4b9a-f88f-4b3c-b410-caf9fd91e0be admin admin] PATH_INFO: `/v3/projects/134159ea75e7494c8af09f2055fde288/users/b603c9d227ab4cce84aa8c6c7224317f/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:22.986813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b9210-261d-4824-9ceb-407499a5ab1c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:22.989353 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c4b9a-f88f-4b3c-b410-caf9fd91e0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=134159ea75e7494c8af09f2055fde288, user_id=b603c9d227ab4cce84aa8c6c7224317f, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:22.999142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c4b9a-f88f-4b3c-b410-caf9fd91e0be admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:23.004871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62519e-ad4e-4d20-b54f-1eaeb93d124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:23.007093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62519e-ad4e-4d20-b54f-1eaeb93d124e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:23.007093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62519e-ad4e-4d20-b54f-1eaeb93d124e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:23.007093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62519e-ad4e-4d20-b54f-1eaeb93d124e admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:23.007093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62519e-ad4e-4d20-b54f-1eaeb93d124e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:23.007497 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62519e-ad4e-4d20-b54f-1eaeb93d124e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:23.011309 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62519e-ad4e-4d20-b54f-1eaeb93d124e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:23.043573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 845/1696] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:22 2022] PUT /identity/v3/projects/134159ea75e7494c8af09f2055fde288/users/b603c9d227ab4cce84aa8c6c7224317f/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:23.046285 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3c35-975d-4cd6-a568-86f7827c8305 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:23.047381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3c35-975d-4cd6-a568-86f7827c8305 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:23.048112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea3c35-975d-4cd6-a568-86f7827c8305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:23.070782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 852/1697] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:23.077634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62519e-ad4e-4d20-b54f-1eaeb93d124e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:23.129024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62519e-ad4e-4d20-b54f-1eaeb93d124e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:23.163054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-25ea3c35-975d-4cd6-a568-86f7827c8305 None None] MFA Rules not processed for user `b603c9d227ab4cce84aa8c6c7224317f`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:23.177701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-25ea3c35-975d-4cd6-a568-86f7827c8305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:23.310461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18dca4-90d6-4c95-a15b-2e3aed43a420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:23.312170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18dca4-90d6-4c95-a15b-2e3aed43a420 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:23.312692 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18dca4-90d6-4c95-a15b-2e3aed43a420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:23.313163 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18dca4-90d6-4c95-a15b-2e3aed43a420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:23.315564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18dca4-90d6-4c95-a15b-2e3aed43a420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:23.321585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18dca4-90d6-4c95-a15b-2e3aed43a420 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:23.362515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 846/1698] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:23.363057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:23.382205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3c35-975d-4cd6-a568-86f7827c8305 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:23.384222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-25ea3c35-975d-4cd6-a568-86f7827c8305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:23.428985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 853/1699] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:23 2022] POST /identity/v3/projects => generated 365 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:59:23.433893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18dca4-90d6-4c95-a15b-2e3aed43a420 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:23.479323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:23.679574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea3c35-975d-4cd6-a568-86f7827c8305 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:23.713839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18dca4-90d6-4c95-a15b-2e3aed43a420 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:23.737068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eba46d-3dcc-4edf-b07b-cd8a161eb77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:23.738336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eba46d-3dcc-4edf-b07b-cd8a161eb77a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:23.738847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eba46d-3dcc-4edf-b07b-cd8a161eb77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:23.739401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eba46d-3dcc-4edf-b07b-cd8a161eb77a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:23.745061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eba46d-3dcc-4edf-b07b-cd8a161eb77a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:23.753956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eba46d-3dcc-4edf-b07b-cd8a161eb77a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:23.826125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 854/1700] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:23 2022] POST /identity/v3/users => generated 283 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:23.839284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eba46d-3dcc-4edf-b07b-cd8a161eb77a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:23.890879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eba46d-3dcc-4edf-b07b-cd8a161eb77a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:23.902668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3641c0-71b8-40e5-9613-fa1c102e741f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:23.903826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3641c0-71b8-40e5-9613-fa1c102e741f service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:23.904347 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3641c0-71b8-40e5-9613-fa1c102e741f service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:23.904842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3641c0-71b8-40e5-9613-fa1c102e741f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:23.914396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1445d-f29b-46e3-b900-d1976b9784d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:23.915615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1445d-f29b-46e3-b900-d1976b9784d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:23.916639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1445d-f29b-46e3-b900-d1976b9784d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:23.917141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1445d-f29b-46e3-b900-d1976b9784d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:23.918579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1445d-f29b-46e3-b900-d1976b9784d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:23.926023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1445d-f29b-46e3-b900-d1976b9784d3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:23.974528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 855/1701] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:59:23.988762 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1445d-f29b-46e3-b900-d1976b9784d3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:24.025292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1445d-f29b-46e3-b900-d1976b9784d3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:24.047265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cb4e0-98dc-4e38-8627-6e7673e561e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:24.048634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb4e0-98dc-4e38-8627-6e7673e561e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:24.049102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb4e0-98dc-4e38-8627-6e7673e561e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:24.049632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cb4e0-98dc-4e38-8627-6e7673e561e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:24.051059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cb4e0-98dc-4e38-8627-6e7673e561e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:24.054242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cb4e0-98dc-4e38-8627-6e7673e561e7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:24.099603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3641c0-71b8-40e5-9613-fa1c102e741f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:24.101415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3641c0-71b8-40e5-9613-fa1c102e741f service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:24.111436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 856/1702] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:24.113142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cb4e0-98dc-4e38-8627-6e7673e561e7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:24.120229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d20cb4e0-98dc-4e38-8627-6e7673e561e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:24.142963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 847/1703] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:24.144995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3641c0-71b8-40e5-9613-fa1c102e741f service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:24.171944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cb4e0-98dc-4e38-8627-6e7673e561e7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:24.189601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:24.191263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:24.191799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:24.192319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] PATH_INFO: `/v3/users/a612f06750134cca9d7c8e9ba6c4a0aa` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:24.195205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a612f06750134cca9d7c8e9ba6c4a0aa)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:24.204203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:24.211771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3641c0-71b8-40e5-9613-fa1c102e741f service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:24.232538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9357-5a7d-48aa-b2f7-395d5031af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:24.233598 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9357-5a7d-48aa-b2f7-395d5031af6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:24.234093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9357-5a7d-48aa-b2f7-395d5031af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:24.234487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9357-5a7d-48aa-b2f7-395d5031af6c admin admin] PATH_INFO: `/v3/projects/c8185bb16b81470f90c1b7d14af098f9/users/ca9dd35de4ec4c9bbf14913d1e163cfb/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:24.320142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9357-5a7d-48aa-b2f7-395d5031af6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8185bb16b81470f90c1b7d14af098f9, user_id=ca9dd35de4ec4c9bbf14913d1e163cfb, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:24.326459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9357-5a7d-48aa-b2f7-395d5031af6c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:24.402983 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a612f06750134cca9d7c8e9ba6c4a0aa'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:24.408071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 848/1704] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:24 2022] PUT /identity/v3/projects/c8185bb16b81470f90c1b7d14af098f9/users/ca9dd35de4ec4c9bbf14913d1e163cfb/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:24.429030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48750bc6-aa9e-4e22-ad86-a5822353daaf None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:24.429471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48750bc6-aa9e-4e22-ad86-a5822353daaf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:24.429985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48750bc6-aa9e-4e22-ad86-a5822353daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:24.469571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a612f06750134cca9d7c8e9ba6c4a0aa'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:24.513426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a612f06750134cca9d7c8e9ba6c4a0aa'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:24.514966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a612f06750134cca9d7c8e9ba6c4a0aa'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:24.542219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f40421fe-c16b-4916-add2-193b9ce95ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a612f06750134cca9d7c8e9ba6c4a0aa'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:24.558200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 857/1705] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:24 2022] DELETE /identity/v3/users/a612f06750134cca9d7c8e9ba6c4a0aa => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:24.564540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6041a-68dc-4de1-aa9a-137aea83efa5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:24.565061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6041a-68dc-4de1-aa9a-137aea83efa5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:24.565515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6041a-68dc-4de1-aa9a-137aea83efa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:24.600912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-48750bc6-aa9e-4e22-ad86-a5822353daaf None None] MFA Rules not processed for user `ca9dd35de4ec4c9bbf14913d1e163cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:24.603128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-48750bc6-aa9e-4e22-ad86-a5822353daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:24.609651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8fb6041a-68dc-4de1-aa9a-137aea83efa5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:24.615429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8fb6041a-68dc-4de1-aa9a-137aea83efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:24.732100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:24.736104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:24.792494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 849/1706] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:24.833106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48750bc6-aa9e-4e22-ad86-a5822353daaf None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:24.835816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-48750bc6-aa9e-4e22-ad86-a5822353daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:24.962038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48750bc6-aa9e-4e22-ad86-a5822353daaf None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:24.976496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44851b0d-1988-4b6c-a1b1-28deae743e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:24.980878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44851b0d-1988-4b6c-a1b1-28deae743e67 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:24.981154 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44851b0d-1988-4b6c-a1b1-28deae743e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:24.982746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44851b0d-1988-4b6c-a1b1-28deae743e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:25.012693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44851b0d-1988-4b6c-a1b1-28deae743e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:25.021971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44851b0d-1988-4b6c-a1b1-28deae743e67 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:25.054614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 850/1707] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:59:25.055270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 858/1708] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:59:25.089038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44851b0d-1988-4b6c-a1b1-28deae743e67 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:25.090770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-44851b0d-1988-4b6c-a1b1-28deae743e67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:25.238898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44851b0d-1988-4b6c-a1b1-28deae743e67 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:25.245411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467937-4863-489d-8164-25966ef79343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:25.246380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467937-4863-489d-8164-25966ef79343 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:25.246844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467937-4863-489d-8164-25966ef79343 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:25.247301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467937-4863-489d-8164-25966ef79343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:25.261153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467937-4863-489d-8164-25966ef79343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:25.263207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467937-4863-489d-8164-25966ef79343 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:25.286985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 851/1709] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:59:25.537863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6041a-68dc-4de1-aa9a-137aea83efa5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:25.543995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8fb6041a-68dc-4de1-aa9a-137aea83efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:25.595375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6041a-68dc-4de1-aa9a-137aea83efa5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:25.618223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:25.624693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:25.625940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:25.628704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] PATH_INFO: `/v3/users/315f396f4450487185bf1d67cdbc2de1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:25.637779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=315f396f4450487185bf1d67cdbc2de1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:25.653075 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:25.892060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315f396f4450487185bf1d67cdbc2de1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:25.921568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315f396f4450487185bf1d67cdbc2de1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:25.967129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315f396f4450487185bf1d67cdbc2de1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:25.968293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315f396f4450487185bf1d67cdbc2de1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:26.007353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315f396f4450487185bf1d67cdbc2de1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:26.044294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 859/1710] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:25 2022] DELETE /identity/v3/users/315f396f4450487185bf1d67cdbc2de1 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:26.050445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc332-92b0-4bfa-8373-af78dc19a6db None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:26.051280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc332-92b0-4bfa-8373-af78dc19a6db None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:26.051688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc332-92b0-4bfa-8373-af78dc19a6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:26.111337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-247dc332-92b0-4bfa-8373-af78dc19a6db None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:26.117203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-247dc332-92b0-4bfa-8373-af78dc19a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:26.188175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:26.193986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:26.292226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 852/1711] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:26.330154 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc332-92b0-4bfa-8373-af78dc19a6db None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:26.333270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-247dc332-92b0-4bfa-8373-af78dc19a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:26.460802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:26.511305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc332-92b0-4bfa-8373-af78dc19a6db None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:26.520517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa7873-2138-415f-96d3-a78c01618bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:26.521937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7873-2138-415f-96d3-a78c01618bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:26.522277 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7873-2138-415f-96d3-a78c01618bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:26.522592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7873-2138-415f-96d3-a78c01618bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:26.549258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa7873-2138-415f-96d3-a78c01618bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:26.551700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa7873-2138-415f-96d3-a78c01618bd3 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:26.577212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af06a3-9a56-47ac-9eb7-7b9586dfd3cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:26.578010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 853/1712] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:59:26.618975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:26.628995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:26.630048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:26.630834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] PATH_INFO: `/v3/projects/4d1dfda86d9e4de1b92dbb103c071df5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:26.646175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1dfda86d9e4de1b92dbb103c071df5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:26.662463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:26.713996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa7873-2138-415f-96d3-a78c01618bd3 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:26.715757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dbaa7873-2138-415f-96d3-a78c01618bd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:26.732566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa7873-2138-415f-96d3-a78c01618bd3 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:26.738896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:26.740061 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:26.740537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:26.741137 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] PATH_INFO: `/v3/users/09981b4e63fa4e43b38601d323880167` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:26.742547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09981b4e63fa4e43b38601d323880167)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:26.745752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:26.827553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09981b4e63fa4e43b38601d323880167'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:26.852240 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09981b4e63fa4e43b38601d323880167'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:26.853525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09981b4e63fa4e43b38601d323880167'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:26.865601 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09981b4e63fa4e43b38601d323880167'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:26.866821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3cf9a10f-2fc8-4446-b54c-b137c0da4257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09981b4e63fa4e43b38601d323880167'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:26.878391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:26.898404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1dfda86d9e4de1b92dbb103c071df5', 'request_id': 'req-56941171-0401-4106-96fb-2f13dae124c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:26.909104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 854/1713] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:26 2022] DELETE /identity/v3/users/09981b4e63fa4e43b38601d323880167 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:26.911305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8eb6a-c310-47bf-80a2-eeff023e5aef None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:26.913002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8eb6a-c310-47bf-80a2-eeff023e5aef None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:26.913630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8eb6a-c310-47bf-80a2-eeff023e5aef None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:26.916830 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 855/1714] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 15:59:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:59:26.919126 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea4976-2b7b-4782-9d4d-884cb53a29d1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:26.919721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea4976-2b7b-4782-9d4d-884cb53a29d1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:26.920213 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea4976-2b7b-4782-9d4d-884cb53a29d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:26.933613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1dfda86d9e4de1b92dbb103c071df5', 'request_id': 'req-56941171-0401-4106-96fb-2f13dae124c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:26.953589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6cea4976-2b7b-4782-9d4d-884cb53a29d1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:26.955733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6cea4976-2b7b-4782-9d4d-884cb53a29d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:26.958720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1dfda86d9e4de1b92dbb103c071df5', 'request_id': 'req-56941171-0401-4106-96fb-2f13dae124c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:27.044189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] The token cache is being invalidate because project 4d1dfda86d9e4de1b92dbb103c071df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:27.044690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:27.046435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56941171-0401-4106-96fb-2f13dae124c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:27.063826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 860/1715] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:26 2022] DELETE /identity/v3/projects/4d1dfda86d9e4de1b92dbb103c071df5 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:27.066478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649cbb-ab41-4e2f-999b-4d2b4074e356 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:27.067013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649cbb-ab41-4e2f-999b-4d2b4074e356 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:27.067524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649cbb-ab41-4e2f-999b-4d2b4074e356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:27.157566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 856/1716] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:27.162941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03aea-97b9-4555-a978-9662c7e7c852 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:27.166727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03aea-97b9-4555-a978-9662c7e7c852 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:27.167303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03aea-97b9-4555-a978-9662c7e7c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:27.170649 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ea649cbb-ab41-4e2f-999b-4d2b4074e356 None None] MFA Rules not processed for user `2d1aeacb83a142db99823f29bd1b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:27.172918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ea649cbb-ab41-4e2f-999b-4d2b4074e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:27.246595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2ed03aea-97b9-4555-a978-9662c7e7c852 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:27.248270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2ed03aea-97b9-4555-a978-9662c7e7c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:27.261409 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 857/1717] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:27.273207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed03aea-97b9-4555-a978-9662c7e7c852 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:27.275963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2ed03aea-97b9-4555-a978-9662c7e7c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:27.433797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:27.469667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed03aea-97b9-4555-a978-9662c7e7c852 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:27.488976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bfdbc-ff9c-49ea-b2df-25dc01fd6140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:27.493904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bfdbc-ff9c-49ea-b2df-25dc01fd6140 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:27.494444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bfdbc-ff9c-49ea-b2df-25dc01fd6140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:27.497476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bfdbc-ff9c-49ea-b2df-25dc01fd6140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:27.516350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 861/1718] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:27.518213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bf070-b55d-4e02-9193-2f6dae16a3c5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:27.520144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bf070-b55d-4e02-9193-2f6dae16a3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:27.520647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bf070-b55d-4e02-9193-2f6dae16a3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:27.536777 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bfdbc-ff9c-49ea-b2df-25dc01fd6140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:27.541591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bfdbc-ff9c-49ea-b2df-25dc01fd6140 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:27.586545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7c9bf070-b55d-4e02-9193-2f6dae16a3c5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:27.588939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c9bf070-b55d-4e02-9193-2f6dae16a3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:27.597096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 858/1719] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:59:27.599005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bfdbc-ff9c-49ea-b2df-25dc01fd6140 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:27.611002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1d4bfdbc-ff9c-49ea-b2df-25dc01fd6140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:27.670016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 862/1720] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:27.674575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bf070-b55d-4e02-9193-2f6dae16a3c5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:27.692992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bfdbc-ff9c-49ea-b2df-25dc01fd6140 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:27.702843 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bf070-b55d-4e02-9193-2f6dae16a3c5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:27.716923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8d4c-f456-4cb1-8d5a-8ac04f59ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:27.718027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8d4c-f456-4cb1-8d5a-8ac04f59ea26 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:27.718774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8d4c-f456-4cb1-8d5a-8ac04f59ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:27.719537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8d4c-f456-4cb1-8d5a-8ac04f59ea26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:27.721763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8d4c-f456-4cb1-8d5a-8ac04f59ea26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:27.722603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8d4c-f456-4cb1-8d5a-8ac04f59ea26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:27.724022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:27.724942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:27.725260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:27.725542 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] PATH_INFO: `/v3/projects/57d2dd9dd7b64dcbab9384b1a884055a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:27.726801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8d4c-f456-4cb1-8d5a-8ac04f59ea26 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:27.730508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d2dd9dd7b64dcbab9384b1a884055a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:27.732603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:27.771264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 863/1721] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:59:27.774019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8172-cad6-4515-84df-3ca76f3a9c11 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:27.774019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8172-cad6-4515-84df-3ca76f3a9c11 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:27.775372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8172-cad6-4515-84df-3ca76f3a9c11 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:27.779651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 864/1722] 10.222.0.46 () {54 vars in 960 bytes} [Tue Jun 21 15:59:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:59:27.780502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8172-cad6-4515-84df-3ca76f3a9c11 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:27.818605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8172-cad6-4515-84df-3ca76f3a9c11 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:27.838860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f13358-7796-4851-aae1-416eb8fca1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:27.848291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f13358-7796-4851-aae1-416eb8fca1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:27.849210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f13358-7796-4851-aae1-416eb8fca1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:27.849952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f13358-7796-4851-aae1-416eb8fca1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:27.868930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f13358-7796-4851-aae1-416eb8fca1f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:27.881855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f13358-7796-4851-aae1-416eb8fca1f2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:27.962657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d2dd9dd7b64dcbab9384b1a884055a', 'request_id': 'req-2cc5cd2c-1716-44e8-b74d-1147476ebc27'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:27.995358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d2dd9dd7b64dcbab9384b1a884055a', 'request_id': 'req-2cc5cd2c-1716-44e8-b74d-1147476ebc27'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:28.028679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d2dd9dd7b64dcbab9384b1a884055a', 'request_id': 'req-2cc5cd2c-1716-44e8-b74d-1147476ebc27'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:28.034740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 865/1723] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:27 2022] POST /identity/v3/projects => generated 369 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:28.038229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26c0c-ac65-450e-91c7-a220d5e91255 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:28.038949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26c0c-ac65-450e-91c7-a220d5e91255 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:28.039835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26c0c-ac65-450e-91c7-a220d5e91255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:28.086644 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-83e26c0c-ac65-450e-91c7-a220d5e91255 None None] MFA Rules not processed for user `2d1aeacb83a142db99823f29bd1b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:28.091678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-83e26c0c-ac65-450e-91c7-a220d5e91255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:28.105576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] The token cache is being invalidate because project 57d2dd9dd7b64dcbab9384b1a884055a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:28.106504 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:28.110176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:28.113961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 859/1724] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:27 2022] DELETE /identity/v3/projects/57d2dd9dd7b64dcbab9384b1a884055a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:28.115019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:28.140735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:28.330895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5cd2c-1716-44e8-b74d-1147476ebc27 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:28.412662 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eada43-7c34-4d85-8882-8ef6a5e0c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:28.413373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eada43-7c34-4d85-8882-8ef6a5e0c8fe admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:28.413841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eada43-7c34-4d85-8882-8ef6a5e0c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:28.413977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eada43-7c34-4d85-8882-8ef6a5e0c8fe admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:28.414413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 866/1725] 10.222.0.46 () {58 vars in 1057 bytes} [Tue Jun 21 15:59:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:28.414703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eada43-7c34-4d85-8882-8ef6a5e0c8fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:28.417468 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e26c0c-ac65-450e-91c7-a220d5e91255 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:28.418163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eada43-7c34-4d85-8882-8ef6a5e0c8fe admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:28.426605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-83e26c0c-ac65-450e-91c7-a220d5e91255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:28.449892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 860/1726] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:28 2022] POST /identity/v3/users => generated 285 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:28.449892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eada43-7c34-4d85-8882-8ef6a5e0c8fe admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:28.458606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:28.468261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eada43-7c34-4d85-8882-8ef6a5e0c8fe admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:28.476656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23087a-1a7c-44cf-a230-1e4d6fb515ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:28.477607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23087a-1a7c-44cf-a230-1e4d6fb515ca service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:28.479383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23087a-1a7c-44cf-a230-1e4d6fb515ca service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:28.480874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23087a-1a7c-44cf-a230-1e4d6fb515ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:28.481434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e26c0c-ac65-450e-91c7-a220d5e91255 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:28.483434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9e23087a-1a7c-44cf-a230-1e4d6fb515ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:28.497753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23087a-1a7c-44cf-a230-1e4d6fb515ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:28.500139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23087a-1a7c-44cf-a230-1e4d6fb515ca service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:28.503048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:28.504932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:28.505715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:28.506551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] PATH_INFO: `/v3/users/c5ce280d5de842d78e59a6c75b2582b1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:28.518095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 861/1727] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:28.520061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ce280d5de842d78e59a6c75b2582b1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:28.524046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:28.529567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23087a-1a7c-44cf-a230-1e4d6fb515ca service placement] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:28.542772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23087a-1a7c-44cf-a230-1e4d6fb515ca service placement] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:28.549519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06c807-e81f-492f-97b7-4cc76eb9c2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:28.550502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06c807-e81f-492f-97b7-4cc76eb9c2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:28.550793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06c807-e81f-492f-97b7-4cc76eb9c2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:28.551138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06c807-e81f-492f-97b7-4cc76eb9c2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:28.552009 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06c807-e81f-492f-97b7-4cc76eb9c2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:28.554613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06c807-e81f-492f-97b7-4cc76eb9c2cd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:28.578765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 862/1728] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:28.580226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06c807-e81f-492f-97b7-4cc76eb9c2cd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:28.613726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06c807-e81f-492f-97b7-4cc76eb9c2cd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:28.620161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:28.631313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3637d-a4ba-48b2-84f2-22048c2ec59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:28.632115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3637d-a4ba-48b2-84f2-22048c2ec59f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:28.632656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3637d-a4ba-48b2-84f2-22048c2ec59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:28.632992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3637d-a4ba-48b2-84f2-22048c2ec59f admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:28.633828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3637d-a4ba-48b2-84f2-22048c2ec59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:28.636303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3637d-a4ba-48b2-84f2-22048c2ec59f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:28.684642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 863/1729] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:28.684924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ce280d5de842d78e59a6c75b2582b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:28.686005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3637d-a4ba-48b2-84f2-22048c2ec59f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:28.704672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ce280d5de842d78e59a6c75b2582b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:28.721340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ce280d5de842d78e59a6c75b2582b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:28.722585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ce280d5de842d78e59a6c75b2582b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:28.732612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3637d-a4ba-48b2-84f2-22048c2ec59f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:28.755534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f40a16f-9eaf-4a45-a6ce-c13dac8ef43b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ce280d5de842d78e59a6c75b2582b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:28.761160 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18411-5abf-47c9-9302-2776a462eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:28.763090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18411-5abf-47c9-9302-2776a462eddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:28.763863 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18411-5abf-47c9-9302-2776a462eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:28.768701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 867/1730] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:28 2022] DELETE /identity/v3/users/c5ce280d5de842d78e59a6c75b2582b1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:28.769757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18411-5abf-47c9-9302-2776a462eddd admin admin] PATH_INFO: `/v3/projects/625c0522edcc4b9e999207e3e10eb386/users/5987aa1f9e164ee192dcb06bd314a258/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:28.804952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf18411-5abf-47c9-9302-2776a462eddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=625c0522edcc4b9e999207e3e10eb386, user_id=5987aa1f9e164ee192dcb06bd314a258, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:28.810138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf18411-5abf-47c9-9302-2776a462eddd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:28.855360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 864/1731] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:28 2022] PUT /identity/v3/projects/625c0522edcc4b9e999207e3e10eb386/users/5987aa1f9e164ee192dcb06bd314a258/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:28.863138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eacf0c-2c07-4bef-8b99-46b408e3bcbc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:28.863557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eacf0c-2c07-4bef-8b99-46b408e3bcbc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:28.863778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eacf0c-2c07-4bef-8b99-46b408e3bcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:28.907626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f9eacf0c-2c07-4bef-8b99-46b408e3bcbc None None] MFA Rules not processed for user `5987aa1f9e164ee192dcb06bd314a258`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:28.909016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9eacf0c-2c07-4bef-8b99-46b408e3bcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:29.042191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 868/1732] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:29.049182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18411-5abf-47c9-9302-2776a462eddd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:29.051747 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-edf18411-5abf-47c9-9302-2776a462eddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:29.271475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18411-5abf-47c9-9302-2776a462eddd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:29.285114 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a31eb-b61b-4865-82c2-c559b3440fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:29.285838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a31eb-b61b-4865-82c2-c559b3440fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:29.286155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a31eb-b61b-4865-82c2-c559b3440fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:29.286453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a31eb-b61b-4865-82c2-c559b3440fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:29.287286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a31eb-b61b-4865-82c2-c559b3440fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:29.299506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a31eb-b61b-4865-82c2-c559b3440fe2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:29.368459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 865/1733] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:29 2022] POST /identity/v3/projects => generated 369 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:29.376034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eacf0c-2c07-4bef-8b99-46b408e3bcbc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:29.421163 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eacf0c-2c07-4bef-8b99-46b408e3bcbc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:29.528566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a31eb-b61b-4865-82c2-c559b3440fe2 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:29.531024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cb3a31eb-b61b-4865-82c2-c559b3440fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:29.663408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f65ff8-bc66-480d-8798-85397453eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:29.664645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f65ff8-bc66-480d-8798-85397453eb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:29.665404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f65ff8-bc66-480d-8798-85397453eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:29.665889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f65ff8-bc66-480d-8798-85397453eb41 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:29.667572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f65ff8-bc66-480d-8798-85397453eb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:29.677890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f65ff8-bc66-480d-8798-85397453eb41 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:29.751898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 869/1734] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:29 2022] POST /identity/v3/users => generated 291 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:29.756827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f65ff8-bc66-480d-8798-85397453eb41 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:29.761179 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a31eb-b61b-4865-82c2-c559b3440fe2 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:29.773846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:29.775877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:29.778098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:29.778721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] PATH_INFO: `/v3/projects/8e0314c15067472881d1905c6593110e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:29.780691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f65ff8-bc66-480d-8798-85397453eb41 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:29.781447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0314c15067472881d1905c6593110e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:29.783887 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:29.799570 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc9d6-830e-4d1f-b856-06bc9f4b0a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:29.800284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc9d6-830e-4d1f-b856-06bc9f4b0a35 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:29.801181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc9d6-830e-4d1f-b856-06bc9f4b0a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:29.801538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc9d6-830e-4d1f-b856-06bc9f4b0a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:29.802479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dc9d6-830e-4d1f-b856-06bc9f4b0a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:29.804273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dc9d6-830e-4d1f-b856-06bc9f4b0a35 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:29.831608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 870/1735] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:29.838505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc9d6-830e-4d1f-b856-06bc9f4b0a35 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:29.855504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:29.867579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc9d6-830e-4d1f-b856-06bc9f4b0a35 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:29.892049 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4a85f-f8ac-4ed4-a509-1c6725210085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:29.893093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4a85f-f8ac-4ed4-a509-1c6725210085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:29.893397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4a85f-f8ac-4ed4-a509-1c6725210085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:29.893689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4a85f-f8ac-4ed4-a509-1c6725210085 admin admin] PATH_INFO: `/v3/projects/4b4854badace4cabb1381162daa5c449/users/312225690deb4370b2c91fe172bcb2ea/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:29.924171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:29.937599 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4a85f-f8ac-4ed4-a509-1c6725210085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4854badace4cabb1381162daa5c449, user_id=312225690deb4370b2c91fe172bcb2ea, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:29.942555 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4a85f-f8ac-4ed4-a509-1c6725210085 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:30.010131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 871/1736] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:29 2022] PUT /identity/v3/projects/4b4854badace4cabb1381162daa5c449/users/312225690deb4370b2c91fe172bcb2ea/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:30.016155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4a85f-f8ac-4ed4-a509-1c6725210085 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:30.023962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0314c15067472881d1905c6593110e', 'request_id': 'req-ca3e118b-ae11-4140-b59c-4e206151ae9d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.108494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0314c15067472881d1905c6593110e', 'request_id': 'req-ca3e118b-ae11-4140-b59c-4e206151ae9d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.152336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0314c15067472881d1905c6593110e', 'request_id': 'req-ca3e118b-ae11-4140-b59c-4e206151ae9d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.215488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] The token cache is being invalidate because project 8e0314c15067472881d1905c6593110e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:30.218040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.220467 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.239195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 866/1737] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:29 2022] DELETE /identity/v3/projects/8e0314c15067472881d1905c6593110e => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:59:30.245073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:30.252112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:30.317929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4a85f-f8ac-4ed4-a509-1c6725210085 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:30.335278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e64b87-8d11-44cb-96a5-b033366f7125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:30.336195 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e64b87-8d11-44cb-96a5-b033366f7125 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:30.339903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e64b87-8d11-44cb-96a5-b033366f7125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:30.339903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e64b87-8d11-44cb-96a5-b033366f7125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:30.340291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e64b87-8d11-44cb-96a5-b033366f7125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:30.344584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e64b87-8d11-44cb-96a5-b033366f7125 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:30.377369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 872/1738] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:30.378933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e64b87-8d11-44cb-96a5-b033366f7125 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:30.381147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f0e64b87-8d11-44cb-96a5-b033366f7125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:30.419746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e64b87-8d11-44cb-96a5-b033366f7125 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:30.434991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:30.435956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:30.436231 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:30.436522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] PATH_INFO: `/v3/users/010fea290b59432296c23831dc9284e2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:30.440567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] RBAC: Authorizing `identity:delete_user(user_id=010fea290b59432296c23831dc9284e2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:30.443989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:30.543706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e118b-ae11-4140-b59c-4e206151ae9d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:30.559221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010fea290b59432296c23831dc9284e2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.559877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:30.562271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:30.562766 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:30.563064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] PATH_INFO: `/v3/projects/04f39f1579864470a811c8578e3849bd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:30.565492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f39f1579864470a811c8578e3849bd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:30.572298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:30.596133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010fea290b59432296c23831dc9284e2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.617068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010fea290b59432296c23831dc9284e2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.619636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010fea290b59432296c23831dc9284e2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.644209 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010fea290b59432296c23831dc9284e2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.664997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 873/1739] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:30 2022] DELETE /identity/v3/users/010fea290b59432296c23831dc9284e2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:30.664997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:30.667912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:30.692624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f39f1579864470a811c8578e3849bd', 'request_id': 'req-751f0f92-bb2b-4112-9119-f52fd8066f1b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.733265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f39f1579864470a811c8578e3849bd', 'request_id': 'req-751f0f92-bb2b-4112-9119-f52fd8066f1b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.770970 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f39f1579864470a811c8578e3849bd', 'request_id': 'req-751f0f92-bb2b-4112-9119-f52fd8066f1b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.793167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] The token cache is being invalidate because project 04f39f1579864470a811c8578e3849bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:30.793646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.794557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:30.800775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 867/1740] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:30 2022] DELETE /identity/v3/projects/04f39f1579864470a811c8578e3849bd => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:30.803621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:30.819363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:30.895963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:30.951475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ad77d-d1c9-4499-9d03-f3459e49f23a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:30.986006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:31.006608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1441a04-5d33-47f2-805d-ef0319ba56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:31.010527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1441a04-5d33-47f2-805d-ef0319ba56e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:31.011140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1441a04-5d33-47f2-805d-ef0319ba56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:31.012190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1441a04-5d33-47f2-805d-ef0319ba56e4 admin admin] PATH_INFO: `/v3/projects/4b4854badace4cabb1381162daa5c449/users/312225690deb4370b2c91fe172bcb2ea/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:31.018081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1441a04-5d33-47f2-805d-ef0319ba56e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4854badace4cabb1381162daa5c449, user_id=312225690deb4370b2c91fe172bcb2ea, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:31.045396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1441a04-5d33-47f2-805d-ef0319ba56e4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:31.060262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f0f92-bb2b-4112-9119-f52fd8066f1b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:31.085594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 874/1741] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:30 2022] PUT /identity/v3/projects/4b4854badace4cabb1381162daa5c449/users/312225690deb4370b2c91fe172bcb2ea/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:31.085594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5844f52-18cd-46d3-a1f9-c662cb4e0e4a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:31.085594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5844f52-18cd-46d3-a1f9-c662cb4e0e4a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:31.085594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5844f52-18cd-46d3-a1f9-c662cb4e0e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:31.142675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f5844f52-18cd-46d3-a1f9-c662cb4e0e4a None None] MFA Rules not processed for user `d2359b672db844c6a081df3267b0f9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:31.145537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f5844f52-18cd-46d3-a1f9-c662cb4e0e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:31.366816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 875/1742] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:31.388969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:31.389851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:31.390340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:31.390808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] PATH_INFO: `/v3/users/b603c9d227ab4cce84aa8c6c7224317f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:31.398227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b603c9d227ab4cce84aa8c6c7224317f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:31.423013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab2ba1-9a9f-45dd-8f90-029e42c8f2fd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:31.424009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab2ba1-9a9f-45dd-8f90-029e42c8f2fd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:31.424486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:31.425177 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab2ba1-9a9f-45dd-8f90-029e42c8f2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:31.519087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-91ab2ba1-9a9f-45dd-8f90-029e42c8f2fd None None] MFA Rules not processed for user `312225690deb4370b2c91fe172bcb2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:31.521365 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91ab2ba1-9a9f-45dd-8f90-029e42c8f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:31.702992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 876/1743] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:31.704219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad3fb9-ea6b-4a31-827d-2f1c01d65f83 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:31.704512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad3fb9-ea6b-4a31-827d-2f1c01d65f83 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:31.704803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad3fb9-ea6b-4a31-827d-2f1c01d65f83 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:31.707597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 877/1744] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 15:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:59:31.708898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b7d70-2057-4c6d-ad34-554eae077a3e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:31.709190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b7d70-2057-4c6d-ad34-554eae077a3e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:31.709471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b7d70-2057-4c6d-ad34-554eae077a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:31.762480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7a0b7d70-2057-4c6d-ad34-554eae077a3e None None] MFA Rules not processed for user `d2359b672db844c6a081df3267b0f9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:31.764549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7a0b7d70-2057-4c6d-ad34-554eae077a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:31.765559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b603c9d227ab4cce84aa8c6c7224317f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:31.803523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b603c9d227ab4cce84aa8c6c7224317f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:31.805421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b603c9d227ab4cce84aa8c6c7224317f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:31.824961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b603c9d227ab4cce84aa8c6c7224317f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:31.827015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 878/1745] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:31.848543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b603c9d227ab4cce84aa8c6c7224317f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:31.853887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b7d70-2057-4c6d-ad34-554eae077a3e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:31.869174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7a0b7d70-2057-4c6d-ad34-554eae077a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:31.914202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 868/1746] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:30 2022] DELETE /identity/v3/users/b603c9d227ab4cce84aa8c6c7224317f => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:31.921216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:31.941462 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:31.968522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b7d70-2057-4c6d-ad34-554eae077a3e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:32.274236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:32.291315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883951fd-364b-46f4-b3d7-44b777b83f27 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:32.308890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:32.309829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:32.310121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:32.310408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] PATH_INFO: `/v3/projects/57bd1659f31048439890db2fb989d488` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:32.323872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57bd1659f31048439890db2fb989d488)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:32.327392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:32.329903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:32.339280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:32.339280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:32.339280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] PATH_INFO: `/v3/users/9750c692f9ef4afa8a897747b5c11a81` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:32.339280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9750c692f9ef4afa8a897747b5c11a81)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:32.339280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:32.426084 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:32.528929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57bd1659f31048439890db2fb989d488', 'request_id': 'req-8c49b08f-4d1e-45cf-8d99-de7d62030283'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:32.540436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9750c692f9ef4afa8a897747b5c11a81'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:32.552523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57bd1659f31048439890db2fb989d488', 'request_id': 'req-8c49b08f-4d1e-45cf-8d99-de7d62030283'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:32.574590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57bd1659f31048439890db2fb989d488', 'request_id': 'req-8c49b08f-4d1e-45cf-8d99-de7d62030283'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:32.582401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9750c692f9ef4afa8a897747b5c11a81'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:32.583438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9750c692f9ef4afa8a897747b5c11a81'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:32.607093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9750c692f9ef4afa8a897747b5c11a81'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:32.608744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] The token cache is being invalidate because project 57bd1659f31048439890db2fb989d488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:32.609768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:32.610159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9750c692f9ef4afa8a897747b5c11a81'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:32.611861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8c49b08f-4d1e-45cf-8d99-de7d62030283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:32.614610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 879/1747] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:31 2022] DELETE /identity/v3/projects/57bd1659f31048439890db2fb989d488 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:32.616941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200372c9-6ab4-42be-9919-5626d7438916 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:32.616941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200372c9-6ab4-42be-9919-5626d7438916 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:32.616941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200372c9-6ab4-42be-9919-5626d7438916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:32.654134 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 869/1748] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:31 2022] DELETE /identity/v3/users/9750c692f9ef4afa8a897747b5c11a81 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:32.656729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:32.661159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:32.673736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-200372c9-6ab4-42be-9919-5626d7438916 None None] MFA Rules not processed for user `2d1aeacb83a142db99823f29bd1b7cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:32.675033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-200372c9-6ab4-42be-9919-5626d7438916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:32.827883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409341f-cf61-4e5d-8425-f76f58764d1a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:32.841797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1d508-7335-4ac0-8632-80e88ffac480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:32.843843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d508-7335-4ac0-8632-80e88ffac480 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:32.845822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d508-7335-4ac0-8632-80e88ffac480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:32.846212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d508-7335-4ac0-8632-80e88ffac480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:32.851522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-49d1d508-7335-4ac0-8632-80e88ffac480 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:32.861751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 880/1749] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:32.864048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200372c9-6ab4-42be-9919-5626d7438916 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:32.870894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-200372c9-6ab4-42be-9919-5626d7438916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:33.107447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1d508-7335-4ac0-8632-80e88ffac480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:33.109066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1d508-7335-4ac0-8632-80e88ffac480 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:33.152620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 870/1750] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:32 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:33.158533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5931b5-0fed-4296-825a-6b22f4dc8c56 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:33.159016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5931b5-0fed-4296-825a-6b22f4dc8c56 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:33.159806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5931b5-0fed-4296-825a-6b22f4dc8c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:33.212737 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-df5931b5-0fed-4296-825a-6b22f4dc8c56 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:33.215337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-df5931b5-0fed-4296-825a-6b22f4dc8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:33.378263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200372c9-6ab4-42be-9919-5626d7438916 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:33.387755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:33.424373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411e966-1280-43cf-bda3-62674b87f726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:33.425839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411e966-1280-43cf-bda3-62674b87f726 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:33.437229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411e966-1280-43cf-bda3-62674b87f726 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:33.437785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411e966-1280-43cf-bda3-62674b87f726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:33.442329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7411e966-1280-43cf-bda3-62674b87f726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:33.515258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 871/1751] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:33.516883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5931b5-0fed-4296-825a-6b22f4dc8c56 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:33.519035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-df5931b5-0fed-4296-825a-6b22f4dc8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:33.522064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:33.562781 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5931b5-0fed-4296-825a-6b22f4dc8c56 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:33.575200 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:33.576611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:33.576910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:33.577194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] PATH_INFO: `/v3/projects/2730edb408bd4634b6941d76cf6a6dcc` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:33.592849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2730edb408bd4634b6941d76cf6a6dcc)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:33.598803 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:33.744621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2730edb408bd4634b6941d76cf6a6dcc', 'request_id': 'req-98045aa3-b7a5-4620-889a-974053463925'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:33.764931 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2730edb408bd4634b6941d76cf6a6dcc', 'request_id': 'req-98045aa3-b7a5-4620-889a-974053463925'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:33.807559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2730edb408bd4634b6941d76cf6a6dcc', 'request_id': 'req-98045aa3-b7a5-4620-889a-974053463925'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:33.830242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411e966-1280-43cf-bda3-62674b87f726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:33.846135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411e966-1280-43cf-bda3-62674b87f726 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:33.850846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] The token cache is being invalidate because project 2730edb408bd4634b6941d76cf6a6dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:33.851613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:33.855288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:33.857700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 872/1752] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:33 2022] DELETE /identity/v3/projects/2730edb408bd4634b6941d76cf6a6dcc => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:33.858730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:33.868664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:33.908485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 881/1753] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 1046 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:33.910972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66856b-85d6-4b3e-a727-468dcfbffa0e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:33.926184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66856b-85d6-4b3e-a727-468dcfbffa0e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:33.926977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66856b-85d6-4b3e-a727-468dcfbffa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:34.015721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0a66856b-85d6-4b3e-a727-468dcfbffa0e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:34.015721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0a66856b-85d6-4b3e-a727-468dcfbffa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:34.082014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045aa3-b7a5-4620-889a-974053463925 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:34.102131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12334cb-20fb-4053-b136-798ab529d1b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:34.103580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12334cb-20fb-4053-b136-798ab529d1b8 service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:34.103919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12334cb-20fb-4053-b136-798ab529d1b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:34.104207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12334cb-20fb-4053-b136-798ab529d1b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:34.121109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b12334cb-20fb-4053-b136-798ab529d1b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:34.185075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12334cb-20fb-4053-b136-798ab529d1b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:34.185075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12334cb-20fb-4053-b136-798ab529d1b8 service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:34.208752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 873/1754] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:34.209662 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12334cb-20fb-4053-b136-798ab529d1b8 service placement] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:34.217107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b12334cb-20fb-4053-b136-798ab529d1b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:34.417371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 882/1755] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:34.419079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66856b-85d6-4b3e-a727-468dcfbffa0e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:34.426803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0a66856b-85d6-4b3e-a727-468dcfbffa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:34.468676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12334cb-20fb-4053-b136-798ab529d1b8 service placement] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:34.471099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66856b-85d6-4b3e-a727-468dcfbffa0e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:34.481220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:34.485787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:34.485787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:34.486507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] PATH_INFO: `/v3/projects/0a92c5b8585a42f2841375b6c5fd5f5e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:34.487078 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:34.488029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:34.488326 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:34.491445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] PATH_INFO: `/v3/projects/134159ea75e7494c8af09f2055fde288` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:34.500868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=134159ea75e7494c8af09f2055fde288)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:34.508439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:34.538578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a92c5b8585a42f2841375b6c5fd5f5e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:34.563208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:34.571323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:34.714689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134159ea75e7494c8af09f2055fde288', 'request_id': 'req-3df4afae-d4ee-46df-be37-65e34e5e0ba6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:34.720568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a92c5b8585a42f2841375b6c5fd5f5e', 'request_id': 'req-356dc504-1ea2-4c95-87f7-7d657f380877'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:34.737055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134159ea75e7494c8af09f2055fde288', 'request_id': 'req-3df4afae-d4ee-46df-be37-65e34e5e0ba6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:34.738043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a92c5b8585a42f2841375b6c5fd5f5e', 'request_id': 'req-356dc504-1ea2-4c95-87f7-7d657f380877'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:34.765009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134159ea75e7494c8af09f2055fde288', 'request_id': 'req-3df4afae-d4ee-46df-be37-65e34e5e0ba6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:34.776515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a92c5b8585a42f2841375b6c5fd5f5e', 'request_id': 'req-356dc504-1ea2-4c95-87f7-7d657f380877'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:34.823387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] The token cache is being invalidate because project 0a92c5b8585a42f2841375b6c5fd5f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:34.823387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:34.825922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-356dc504-1ea2-4c95-87f7-7d657f380877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:34.833428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 874/1756] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:34 2022] DELETE /identity/v3/projects/0a92c5b8585a42f2841375b6c5fd5f5e => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:34.836409 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1600ca2-2716-4a4b-beca-3760a2f88ba2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:34.836978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1600ca2-2716-4a4b-beca-3760a2f88ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:34.837466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1600ca2-2716-4a4b-beca-3760a2f88ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:34.841042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] The token cache is being invalidate because project 134159ea75e7494c8af09f2055fde288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:34.844896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:34.847554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:34.857748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 883/1757] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:34 2022] DELETE /identity/v3/projects/134159ea75e7494c8af09f2055fde288 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:34.860119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:34.870188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:34.919983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d1600ca2-2716-4a4b-beca-3760a2f88ba2 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:34.923209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d1600ca2-2716-4a4b-beca-3760a2f88ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:34.979329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:35.051233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4afae-d4ee-46df-be37-65e34e5e0ba6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:35.085001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 875/1758] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:35.086064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1600ca2-2716-4a4b-beca-3760a2f88ba2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:35.091540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d1600ca2-2716-4a4b-beca-3760a2f88ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:35.120931 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1600ca2-2716-4a4b-beca-3760a2f88ba2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:35.136398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:35.138075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:35.138507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:35.138800 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] PATH_INFO: `/v3/users/1aea8e8e7f2d46168c2942d8e2bbb03b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:35.145034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aea8e8e7f2d46168c2942d8e2bbb03b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:35.146645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:35.266419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70b672-ceff-410c-abc5-2ae34443b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:35.269194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70b672-ceff-410c-abc5-2ae34443b491 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:35.269707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70b672-ceff-410c-abc5-2ae34443b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:35.270028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70b672-ceff-410c-abc5-2ae34443b491 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:35.271385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70b672-ceff-410c-abc5-2ae34443b491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:35.271941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70b672-ceff-410c-abc5-2ae34443b491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:35.275516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70b672-ceff-410c-abc5-2ae34443b491 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:35.299442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 884/1759] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:35.302123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aea8e8e7f2d46168c2942d8e2bbb03b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:35.304758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7ba7-4f72-45ae-b72f-79570808b8ce None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:35.305039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7ba7-4f72-45ae-b72f-79570808b8ce None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:35.306092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7ba7-4f72-45ae-b72f-79570808b8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:35.329762 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-aa6d7ba7-4f72-45ae-b72f-79570808b8ce None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:35.331208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aa6d7ba7-4f72-45ae-b72f-79570808b8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:35.347697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aea8e8e7f2d46168c2942d8e2bbb03b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:35.349251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 885/1760] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:35.349442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aea8e8e7f2d46168c2942d8e2bbb03b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:35.356580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454545b7-d6e9-43e1-8a14-5d6260e5868e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:35.356915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454545b7-d6e9-43e1-8a14-5d6260e5868e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:35.366188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454545b7-d6e9-43e1-8a14-5d6260e5868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:35.384651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aea8e8e7f2d46168c2942d8e2bbb03b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:35.390302 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64ff6568-12eb-4595-bba5-3992871b9c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aea8e8e7f2d46168c2942d8e2bbb03b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:35.421483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-454545b7-d6e9-43e1-8a14-5d6260e5868e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:35.423445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-454545b7-d6e9-43e1-8a14-5d6260e5868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:35.434174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 876/1761] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:35 2022] DELETE /identity/v3/users/1aea8e8e7f2d46168c2942d8e2bbb03b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:35.434174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d35db5-55b5-428e-a8ab-66d95cbee46e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:35.434546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d35db5-55b5-428e-a8ab-66d95cbee46e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:35.434949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d35db5-55b5-428e-a8ab-66d95cbee46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:35.456091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:35.526372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-39d35db5-55b5-428e-a8ab-66d95cbee46e None None] MFA Rules not processed for user `74f447686a3a41ef8300b20c04c9776a`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:35.527376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-39d35db5-55b5-428e-a8ab-66d95cbee46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:35.729268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 886/1762] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:35.730638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454545b7-d6e9-43e1-8a14-5d6260e5868e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:35.731995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 877/1763] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:35.733996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423344f-8d03-4d6f-867d-28d62a067c32 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:35.734300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423344f-8d03-4d6f-867d-28d62a067c32 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:35.734590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423344f-8d03-4d6f-867d-28d62a067c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:35.752739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-454545b7-d6e9-43e1-8a14-5d6260e5868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:35.776795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b423344f-8d03-4d6f-867d-28d62a067c32 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:35.778586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b423344f-8d03-4d6f-867d-28d62a067c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:35.797944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454545b7-d6e9-43e1-8a14-5d6260e5868e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:35.801990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 878/1764] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:35.811644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef179e-249f-481b-9101-edfcd823731d None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:35.811939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef179e-249f-481b-9101-edfcd823731d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:35.812228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef179e-249f-481b-9101-edfcd823731d None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:35.818155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 879/1765] 10.222.0.46 () {54 vars in 912 bytes} [Tue Jun 21 15:59:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:59:35.820096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef179e-249f-481b-9101-edfcd823731d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:35.821817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff6a9-952f-4c77-9d47-2e06b5f907a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:35.823375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff6a9-952f-4c77-9d47-2e06b5f907a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:35.824029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff6a9-952f-4c77-9d47-2e06b5f907a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:35.824528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff6a9-952f-4c77-9d47-2e06b5f907a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:35.825866 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff6a9-952f-4c77-9d47-2e06b5f907a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:35.834094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff6a9-952f-4c77-9d47-2e06b5f907a4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:35.875792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef179e-249f-481b-9101-edfcd823731d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:35.895583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd48f10-34b6-432e-a37c-49d644032de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:35.895583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd48f10-34b6-432e-a37c-49d644032de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:35.895583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd48f10-34b6-432e-a37c-49d644032de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:35.895583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd48f10-34b6-432e-a37c-49d644032de2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:35.896064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd48f10-34b6-432e-a37c-49d644032de2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:35.896700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd48f10-34b6-432e-a37c-49d644032de2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:35.900834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd48f10-34b6-432e-a37c-49d644032de2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:35.961897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 880/1766] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:35.964594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c8eed-01c9-47b2-a4e4-9dc642bd82e6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:35.965151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c8eed-01c9-47b2-a4e4-9dc642bd82e6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:35.965866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c8eed-01c9-47b2-a4e4-9dc642bd82e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:35.981693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 887/1767] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:35 2022] POST /identity/v3/projects => generated 365 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:35.981693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff6a9-952f-4c77-9d47-2e06b5f907a4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:36.021292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-419c8eed-01c9-47b2-a4e4-9dc642bd82e6 None None] MFA Rules not processed for user `74f447686a3a41ef8300b20c04c9776a`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:36.025722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-419c8eed-01c9-47b2-a4e4-9dc642bd82e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:36.137382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:36.161670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff6a9-952f-4c77-9d47-2e06b5f907a4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:36.174566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12038d-1d1f-436a-a514-8b889ea7c363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:36.175649 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12038d-1d1f-436a-a514-8b889ea7c363 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:36.176304 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12038d-1d1f-436a-a514-8b889ea7c363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:36.176601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12038d-1d1f-436a-a514-8b889ea7c363 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:36.178256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12038d-1d1f-436a-a514-8b889ea7c363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:36.178611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12038d-1d1f-436a-a514-8b889ea7c363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:36.180770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12038d-1d1f-436a-a514-8b889ea7c363 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:36.201947 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 888/1768] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:36.203309 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead86cd-8726-4b0c-8172-0028578d4389 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:36.203609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead86cd-8726-4b0c-8172-0028578d4389 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:36.203947 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead86cd-8726-4b0c-8172-0028578d4389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:36.250020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 881/1769] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:36.251246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c8eed-01c9-47b2-a4e4-9dc642bd82e6 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:36.280622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6ead86cd-8726-4b0c-8172-0028578d4389 None None] MFA Rules not processed for user `2d3018419d0548eda04b3539681f3df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:36.282880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6ead86cd-8726-4b0c-8172-0028578d4389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:36.288732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c8eed-01c9-47b2-a4e4-9dc642bd82e6 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:36.307820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2470ce7-8359-4344-be08-8e6b054cc116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:36.308602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2470ce7-8359-4344-be08-8e6b054cc116 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:36.311622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2470ce7-8359-4344-be08-8e6b054cc116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:36.311858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2470ce7-8359-4344-be08-8e6b054cc116 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:36.312669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2470ce7-8359-4344-be08-8e6b054cc116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:36.315837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2470ce7-8359-4344-be08-8e6b054cc116 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:36.360674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 882/1770] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:36 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:36.362245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2470ce7-8359-4344-be08-8e6b054cc116 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:36.374062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 889/1771] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 15:59:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:36.388207 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead86cd-8726-4b0c-8172-0028578d4389 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:36.390337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6ead86cd-8726-4b0c-8172-0028578d4389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:36.410695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead86cd-8726-4b0c-8172-0028578d4389 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:36.517374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:36.523250 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:36.523250 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:36.523250 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] PATH_INFO: `/v3/projects/2fbd886823354655ab3b15d646ced92e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:36.537346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbd886823354655ab3b15d646ced92e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:36.542046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:36.559252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:36.583862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2470ce7-8359-4344-be08-8e6b054cc116 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:36.597405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadf4aa-8682-459a-b61f-146ce649f7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:36.598130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadf4aa-8682-459a-b61f-146ce649f7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:36.598422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadf4aa-8682-459a-b61f-146ce649f7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:36.598708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadf4aa-8682-459a-b61f-146ce649f7f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:36.601131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadf4aa-8682-459a-b61f-146ce649f7f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:36.603317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadf4aa-8682-459a-b61f-146ce649f7f0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:36.646831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 883/1772] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:36 2022] POST /identity/v3/users => generated 283 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:36.649456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadf4aa-8682-459a-b61f-146ce649f7f0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:36.675323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadf4aa-8682-459a-b61f-146ce649f7f0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:36.693382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e685-769f-4a63-a487-4ec92b2ef0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:36.693382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e685-769f-4a63-a487-4ec92b2ef0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:36.693382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e685-769f-4a63-a487-4ec92b2ef0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:36.693922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7e685-769f-4a63-a487-4ec92b2ef0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:36.696269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7e685-769f-4a63-a487-4ec92b2ef0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:36.702447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7e685-769f-4a63-a487-4ec92b2ef0c7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:36.727860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbd886823354655ab3b15d646ced92e', 'request_id': 'req-41a8c771-d8d8-4835-850b-987b2fcee343'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:36.741915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbd886823354655ab3b15d646ced92e', 'request_id': 'req-41a8c771-d8d8-4835-850b-987b2fcee343'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:36.781365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 884/1773] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:36 2022] POST /identity/v3/projects => generated 355 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:36.782944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e685-769f-4a63-a487-4ec92b2ef0c7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:36.785315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbd886823354655ab3b15d646ced92e', 'request_id': 'req-41a8c771-d8d8-4835-850b-987b2fcee343'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:36.793252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-eea7e685-769f-4a63-a487-4ec92b2ef0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:36.819605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] The token cache is being invalidate because project 2fbd886823354655ab3b15d646ced92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:36.820115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:36.821667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:36.824687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 890/1774] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:36 2022] DELETE /identity/v3/projects/2fbd886823354655ab3b15d646ced92e => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:36.828822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:36.829659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:36.850863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:36.994670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8c771-d8d8-4835-850b-987b2fcee343 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.058007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7e685-769f-4a63-a487-4ec92b2ef0c7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.069991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b5ddb-d6e0-4018-960f-38d5a634affb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.070700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5ddb-d6e0-4018-960f-38d5a634affb service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.070988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5ddb-d6e0-4018-960f-38d5a634affb service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.071995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5ddb-d6e0-4018-960f-38d5a634affb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.074398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6c2b5ddb-d6e0-4018-960f-38d5a634affb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:37.110698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab9a4e-20fa-4ba7-8d31-356e7313498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.111510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab9a4e-20fa-4ba7-8d31-356e7313498b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.112360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab9a4e-20fa-4ba7-8d31-356e7313498b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.112360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab9a4e-20fa-4ba7-8d31-356e7313498b admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.112805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab9a4e-20fa-4ba7-8d31-356e7313498b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.115042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab9a4e-20fa-4ba7-8d31-356e7313498b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.173316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 891/1775] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:36 2022] POST /identity/v3/users => generated 294 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:37.173316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab9a4e-20fa-4ba7-8d31-356e7313498b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.181373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-30ab9a4e-20fa-4ba7-8d31-356e7313498b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:37.199632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b5ddb-d6e0-4018-960f-38d5a634affb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.201826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b5ddb-d6e0-4018-960f-38d5a634affb service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.215997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 885/1776] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:37.217351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b5ddb-d6e0-4018-960f-38d5a634affb service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.219133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6c2b5ddb-d6e0-4018-960f-38d5a634affb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:37.241723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b5ddb-d6e0-4018-960f-38d5a634affb service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.251737 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3ac95-e8e0-46bf-befe-373b3df9e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.252963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3ac95-e8e0-46bf-befe-373b3df9e30e admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.253485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3ac95-e8e0-46bf-befe-373b3df9e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.253970 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3ac95-e8e0-46bf-befe-373b3df9e30e admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.255087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3ac95-e8e0-46bf-befe-373b3df9e30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.257271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3ac95-e8e0-46bf-befe-373b3df9e30e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.267752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab9a4e-20fa-4ba7-8d31-356e7313498b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.273807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 886/1777] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:37.275252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3ac95-e8e0-46bf-befe-373b3df9e30e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.278218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f98f5f-2cba-4cdc-bef7-5d5e488c1cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.280441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f98f5f-2cba-4cdc-bef7-5d5e488c1cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.280914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f98f5f-2cba-4cdc-bef7-5d5e488c1cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.281208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f98f5f-2cba-4cdc-bef7-5d5e488c1cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.281372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f8a3ac95-e8e0-46bf-befe-373b3df9e30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:37.283366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c2f98f5f-2cba-4cdc-bef7-5d5e488c1cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:37.303393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f98f5f-2cba-4cdc-bef7-5d5e488c1cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.304926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f98f5f-2cba-4cdc-bef7-5d5e488c1cb5 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.313471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3ac95-e8e0-46bf-befe-373b3df9e30e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.317889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 892/1778] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:37.328409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a244a-d5b2-4ecd-a196-ac73b519be63 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.328865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a244a-d5b2-4ecd-a196-ac73b519be63 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.329206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a244a-d5b2-4ecd-a196-ac73b519be63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.339555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391efa98-59b9-4c83-9355-927032b46c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.341123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391efa98-59b9-4c83-9355-927032b46c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.342526 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391efa98-59b9-4c83-9355-927032b46c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.349988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391efa98-59b9-4c83-9355-927032b46c88 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.351831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391efa98-59b9-4c83-9355-927032b46c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.356978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391efa98-59b9-4c83-9355-927032b46c88 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.398328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a27a244a-d5b2-4ecd-a196-ac73b519be63 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:37.406655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a27a244a-d5b2-4ecd-a196-ac73b519be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:37.408713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 887/1779] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:37 2022] POST /identity/v3/users => generated 278 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:37.425640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391efa98-59b9-4c83-9355-927032b46c88 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.444459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391efa98-59b9-4c83-9355-927032b46c88 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.452299 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dbc24-c14e-4fe9-b46e-21b01ab469a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.457730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dbc24-c14e-4fe9-b46e-21b01ab469a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.458033 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dbc24-c14e-4fe9-b46e-21b01ab469a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.460047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 893/1780] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:37.461085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dbc24-c14e-4fe9-b46e-21b01ab469a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.461665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a244a-d5b2-4ecd-a196-ac73b519be63 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.462691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dbc24-c14e-4fe9-b46e-21b01ab469a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.464809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dbc24-c14e-4fe9-b46e-21b01ab469a9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.469712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a27a244a-d5b2-4ecd-a196-ac73b519be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:37.492789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 888/1781] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:37.492789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dbc24-c14e-4fe9-b46e-21b01ab469a9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.514867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dbc24-c14e-4fe9-b46e-21b01ab469a9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.518713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a244a-d5b2-4ecd-a196-ac73b519be63 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.531891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410a41f-db56-4c31-b543-6f982ba19df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.532586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a41f-db56-4c31-b543-6f982ba19df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.532862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a41f-db56-4c31-b543-6f982ba19df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.533142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a41f-db56-4c31-b543-6f982ba19df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.534048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410a41f-db56-4c31-b543-6f982ba19df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.535859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410a41f-db56-4c31-b543-6f982ba19df9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.539073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.547514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.548234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.548744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] PATH_INFO: `/v3/users/5987aa1f9e164ee192dcb06bd314a258` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.551129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5987aa1f9e164ee192dcb06bd314a258)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.554788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 889/1782] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:37.559400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410a41f-db56-4c31-b543-6f982ba19df9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.559681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.571684 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410a41f-db56-4c31-b543-6f982ba19df9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.578681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1744d51-5a1d-4de8-b718-777159f6a9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.579294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1744d51-5a1d-4de8-b718-777159f6a9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.579806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1744d51-5a1d-4de8-b718-777159f6a9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.580117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1744d51-5a1d-4de8-b718-777159f6a9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.580953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1744d51-5a1d-4de8-b718-777159f6a9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.583096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1744d51-5a1d-4de8-b718-777159f6a9b5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.594777 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:37.612999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 890/1783] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:37.614739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86df1-82df-4de2-bcf1-e7825889f026 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.615499 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86df1-82df-4de2-bcf1-e7825889f026 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.615792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86df1-82df-4de2-bcf1-e7825889f026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.665565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-92d86df1-82df-4de2-bcf1-e7825889f026 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:37.667077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-92d86df1-82df-4de2-bcf1-e7825889f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:37.677633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 891/1784] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:37.678635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86df1-82df-4de2-bcf1-e7825889f026 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.699490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86df1-82df-4de2-bcf1-e7825889f026 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.705759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c9190-362e-4532-8916-e1f4aac1cda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.706599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c9190-362e-4532-8916-e1f4aac1cda2 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.706992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c9190-362e-4532-8916-e1f4aac1cda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.707399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c9190-362e-4532-8916-e1f4aac1cda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.708231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c9190-362e-4532-8916-e1f4aac1cda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.710364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c9190-362e-4532-8916-e1f4aac1cda2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.740364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 892/1785] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:37.741840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c9190-362e-4532-8916-e1f4aac1cda2 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.758491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:37.777681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c9190-362e-4532-8916-e1f4aac1cda2 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:37.786075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99d9f4-194e-4f4b-8328-f286a89face3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:37.787066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99d9f4-194e-4f4b-8328-f286a89face3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:37.788187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99d9f4-194e-4f4b-8328-f286a89face3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:37.788454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99d9f4-194e-4f4b-8328-f286a89face3 admin admin] PATH_INFO: `/v3/projects/5e7ceab97a2e4553a59407a693ad0b2e/users/828e168d00314cf2bde9922466a291d8/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:37.789510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5987aa1f9e164ee192dcb06bd314a258'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:37.828462 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99d9f4-194e-4f4b-8328-f286a89face3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7ceab97a2e4553a59407a693ad0b2e, user_id=828e168d00314cf2bde9922466a291d8, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:37.833735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99d9f4-194e-4f4b-8328-f286a89face3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:37.834358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5987aa1f9e164ee192dcb06bd314a258'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:37.872109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5987aa1f9e164ee192dcb06bd314a258'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:37.875839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5987aa1f9e164ee192dcb06bd314a258'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:37.884196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 893/1786] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:37 2022] PUT /identity/v3/projects/5e7ceab97a2e4553a59407a693ad0b2e/users/828e168d00314cf2bde9922466a291d8/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:37.890138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5987aa1f9e164ee192dcb06bd314a258'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:37.896490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99d9f4-194e-4f4b-8328-f286a89face3 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.904053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6a99d9f4-194e-4f4b-8328-f286a89face3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:37.910642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 894/1787] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:37 2022] DELETE /identity/v3/users/5987aa1f9e164ee192dcb06bd314a258 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:37.912149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:37.914023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:38.033871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99d9f4-194e-4f4b-8328-f286a89face3 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:38.087569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd2e4-954b-4ec6-8213-81dfecd524ad admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:38.102654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ccdc-58eb-4a3f-a521-2ae61f4c37ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:38.103814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ccdc-58eb-4a3f-a521-2ae61f4c37ae admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:38.104107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ccdc-58eb-4a3f-a521-2ae61f4c37ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:38.104395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ccdc-58eb-4a3f-a521-2ae61f4c37ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:38.105185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3ccdc-58eb-4a3f-a521-2ae61f4c37ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:38.105504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3ccdc-58eb-4a3f-a521-2ae61f4c37ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:38.108684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3ccdc-58eb-4a3f-a521-2ae61f4c37ae admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:38.168413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 895/1788] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:38.170542 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ccdc-58eb-4a3f-a521-2ae61f4c37ae admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:38.187284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f5c3ccdc-58eb-4a3f-a521-2ae61f4c37ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:38.200591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bd0fa-66ef-44dd-a8e0-5d4c84f5c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:38.201384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd0fa-66ef-44dd-a8e0-5d4c84f5c8ea admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:38.201730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd0fa-66ef-44dd-a8e0-5d4c84f5c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:38.201873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bd0fa-66ef-44dd-a8e0-5d4c84f5c8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:38.202683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bd0fa-66ef-44dd-a8e0-5d4c84f5c8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:38.205614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bd0fa-66ef-44dd-a8e0-5d4c84f5c8ea admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:38.243840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 894/1789] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:38.245437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ccdc-58eb-4a3f-a521-2ae61f4c37ae admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:38.245625 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd52eb-0c52-4849-bda0-4244ef6da3da None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:38.245754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd52eb-0c52-4849-bda0-4244ef6da3da None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:38.246029 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd52eb-0c52-4849-bda0-4244ef6da3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:38.263100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe60992-532e-4710-81bc-fded27821d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:38.264086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe60992-532e-4710-81bc-fded27821d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:38.264382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe60992-532e-4710-81bc-fded27821d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:38.268060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe60992-532e-4710-81bc-fded27821d25 admin admin] PATH_INFO: `/v3/projects/9b6b40a49de34452960ba5ef338674f5/users/476dc40c112f41a183b2a11a5c2ae763/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:38.336841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe60992-532e-4710-81bc-fded27821d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6b40a49de34452960ba5ef338674f5, user_id=476dc40c112f41a183b2a11a5c2ae763, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:38.341794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-12fd52eb-0c52-4849-bda0-4244ef6da3da None None] MFA Rules not processed for user `828e168d00314cf2bde9922466a291d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:38.346885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe60992-532e-4710-81bc-fded27821d25 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:38.352023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-12fd52eb-0c52-4849-bda0-4244ef6da3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:38.403202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 896/1790] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:38 2022] PUT /identity/v3/projects/9b6b40a49de34452960ba5ef338674f5/users/476dc40c112f41a183b2a11a5c2ae763/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:38.403202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a753-71ce-4f6e-91e3-52d0d7270560 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:38.403202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a753-71ce-4f6e-91e3-52d0d7270560 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:38.403202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a753-71ce-4f6e-91e3-52d0d7270560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:38.450004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b202a753-71ce-4f6e-91e3-52d0d7270560 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:38.451636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b202a753-71ce-4f6e-91e3-52d0d7270560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:38.470150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:38.522455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 895/1791] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:38.528378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd52eb-0c52-4849-bda0-4244ef6da3da None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:38.573832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd52eb-0c52-4849-bda0-4244ef6da3da None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:38.659583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 897/1792] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:38.661323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202a753-71ce-4f6e-91e3-52d0d7270560 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:38.678069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202a753-71ce-4f6e-91e3-52d0d7270560 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:38.687702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370362c2-c4e9-42df-b5f7-f2fa514b3a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:38.690131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370362c2-c4e9-42df-b5f7-f2fa514b3a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:38.690742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370362c2-c4e9-42df-b5f7-f2fa514b3a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:38.691101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370362c2-c4e9-42df-b5f7-f2fa514b3a97 admin admin] PATH_INFO: `/v3/projects/fed1c17142614dbaa95a7076e5f35d3e/users/bb718b2467924fc3a22e34e23f195c52/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:38.726893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370362c2-c4e9-42df-b5f7-f2fa514b3a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed1c17142614dbaa95a7076e5f35d3e, user_id=bb718b2467924fc3a22e34e23f195c52, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:38.729077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2f57f-0806-4612-b833-95c6dce30ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:38.729919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f57f-0806-4612-b833-95c6dce30ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:38.730313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f57f-0806-4612-b833-95c6dce30ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:38.730700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f57f-0806-4612-b833-95c6dce30ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:38.731393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370362c2-c4e9-42df-b5f7-f2fa514b3a97 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:38.731660 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2f57f-0806-4612-b833-95c6dce30ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:38.737722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2f57f-0806-4612-b833-95c6dce30ee6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:38.763737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 898/1793] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:38 2022] PUT /identity/v3/projects/fed1c17142614dbaa95a7076e5f35d3e/users/bb718b2467924fc3a22e34e23f195c52/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:38.769743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf53bfc-a396-4c23-89f2-2918b7e3f9cf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:38.770140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf53bfc-a396-4c23-89f2-2918b7e3f9cf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:38.773234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf53bfc-a396-4c23-89f2-2918b7e3f9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:38.784359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:38.801372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 896/1794] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:38 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:38.806119 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2f57f-0806-4612-b833-95c6dce30ee6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:38.807521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-74f2f57f-0806-4612-b833-95c6dce30ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:38.854897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-abf53bfc-a396-4c23-89f2-2918b7e3f9cf None None] MFA Rules not processed for user `476dc40c112f41a183b2a11a5c2ae763`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:38.864957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-abf53bfc-a396-4c23-89f2-2918b7e3f9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:38.922911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2f57f-0806-4612-b833-95c6dce30ee6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:38.933650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e151407-9cb4-4836-9f69-b0491e522ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:38.934678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e151407-9cb4-4836-9f69-b0491e522ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:38.935454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e151407-9cb4-4836-9f69-b0491e522ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:38.936069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e151407-9cb4-4836-9f69-b0491e522ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:38.936976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e151407-9cb4-4836-9f69-b0491e522ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:38.939857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e151407-9cb4-4836-9f69-b0491e522ab7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:38.979593 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 897/1795] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:38 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:38.980514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e151407-9cb4-4836-9f69-b0491e522ab7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:38.982494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7e151407-9cb4-4836-9f69-b0491e522ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:39.001213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 899/1796] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:39.003315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584dfc-b21f-46b7-b1e3-afebef84cd11 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:39.003614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584dfc-b21f-46b7-b1e3-afebef84cd11 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:39.003877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584dfc-b21f-46b7-b1e3-afebef84cd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:39.062223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bb584dfc-b21f-46b7-b1e3-afebef84cd11 None None] MFA Rules not processed for user `bb718b2467924fc3a22e34e23f195c52`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:39.064136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bb584dfc-b21f-46b7-b1e3-afebef84cd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:39.079862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:39.085109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e151407-9cb4-4836-9f69-b0491e522ab7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:39.094425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166994b8-9651-4563-b6db-66f3f79070e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:39.095222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166994b8-9651-4563-b6db-66f3f79070e4 service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:39.095578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166994b8-9651-4563-b6db-66f3f79070e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:39.095949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166994b8-9651-4563-b6db-66f3f79070e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:39.098406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-166994b8-9651-4563-b6db-66f3f79070e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:39.113463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166994b8-9651-4563-b6db-66f3f79070e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:39.119654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166994b8-9651-4563-b6db-66f3f79070e4 service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:39.134974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 898/1797] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:39.136116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166994b8-9651-4563-b6db-66f3f79070e4 service placement] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:39.137754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-166994b8-9651-4563-b6db-66f3f79070e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:39.205993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 900/1798] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:39 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:39.206994 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584dfc-b21f-46b7-b1e3-afebef84cd11 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:39.261708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166994b8-9651-4563-b6db-66f3f79070e4 service placement] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:39.269112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a564cb-0ba4-4ee2-b63e-3442a3b767b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:39.270679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a564cb-0ba4-4ee2-b63e-3442a3b767b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:39.271328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a564cb-0ba4-4ee2-b63e-3442a3b767b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:39.271979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a564cb-0ba4-4ee2-b63e-3442a3b767b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:39.444241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a564cb-0ba4-4ee2-b63e-3442a3b767b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:39.447145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a564cb-0ba4-4ee2-b63e-3442a3b767b4 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:39.476617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 899/1799] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:39.485161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fde5d-5a85-44a9-9d64-4c8d8763313e None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:39.485529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fde5d-5a85-44a9-9d64-4c8d8763313e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:39.491477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fde5d-5a85-44a9-9d64-4c8d8763313e None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:39.493448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 900/1800] 10.222.0.46 () {54 vars in 912 bytes} [Tue Jun 21 15:59:39 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:59:39.499879 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fde5d-5a85-44a9-9d64-4c8d8763313e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:39.501703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5e5fde5d-5a85-44a9-9d64-4c8d8763313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:39.557072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fde5d-5a85-44a9-9d64-4c8d8763313e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:39.571487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:39.572604 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:39.572898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:39.573182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] PATH_INFO: `/v3/users/ca9dd35de4ec4c9bbf14913d1e163cfb` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:39.575557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584dfc-b21f-46b7-b1e3-afebef84cd11 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:39.578701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9dd35de4ec4c9bbf14913d1e163cfb)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:39.583829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:39.589279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827c44-6fb6-40b9-9636-dfb4c6df7aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:39.589991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827c44-6fb6-40b9-9636-dfb4c6df7aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:39.590280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827c44-6fb6-40b9-9636-dfb4c6df7aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:39.592026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827c44-6fb6-40b9-9636-dfb4c6df7aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:39.593585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78827c44-6fb6-40b9-9636-dfb4c6df7aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:39.596047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78827c44-6fb6-40b9-9636-dfb4c6df7aa1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:39.646194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 901/1801] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:39 2022] POST /identity/v3/users => generated 287 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:39.646194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827c44-6fb6-40b9-9636-dfb4c6df7aa1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:39.678834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78827c44-6fb6-40b9-9636-dfb4c6df7aa1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:39.690468 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9dd35de4ec4c9bbf14913d1e163cfb'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:39.700007 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5a0d-9ce7-471c-b822-96b9f0c6ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:39.700724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5a0d-9ce7-471c-b822-96b9f0c6ed99 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:39.701183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5a0d-9ce7-471c-b822-96b9f0c6ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:39.701642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5a0d-9ce7-471c-b822-96b9f0c6ed99 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:39.702534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae5a0d-9ce7-471c-b822-96b9f0c6ed99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:39.705003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae5a0d-9ce7-471c-b822-96b9f0c6ed99 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:39.729075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9dd35de4ec4c9bbf14913d1e163cfb'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:39.730728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:39.731545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9dd35de4ec4c9bbf14913d1e163cfb'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:39.759990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9dd35de4ec4c9bbf14913d1e163cfb'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:39.761796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9dd35de4ec4c9bbf14913d1e163cfb'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:39.766785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 902/1802] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:39 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:39.768275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5a0d-9ce7-471c-b822-96b9f0c6ed99 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:39.773554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4cae5a0d-9ce7-471c-b822-96b9f0c6ed99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:39.814870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 901/1803] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:39 2022] DELETE /identity/v3/users/ca9dd35de4ec4c9bbf14913d1e163cfb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:39.815814 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:39.816822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5a0d-9ce7-471c-b822-96b9f0c6ed99 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:39.817338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:39.863484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:39.983245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c549fc-6268-45a7-bc78-b9f165975c88 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:39.983392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f47beb-bcb8-4935-af47-c647fb5443b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:39.984823 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f47beb-bcb8-4935-af47-c647fb5443b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:39.986558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f47beb-bcb8-4935-af47-c647fb5443b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:39.988016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f47beb-bcb8-4935-af47-c647fb5443b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:39.991005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2638d-aee5-43f0-92e7-97e98da34bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:39.991843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2638d-aee5-43f0-92e7-97e98da34bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:39.992400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2638d-aee5-43f0-92e7-97e98da34bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:39.993023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2638d-aee5-43f0-92e7-97e98da34bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:39.994778 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2638d-aee5-43f0-92e7-97e98da34bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:39.995828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f47beb-bcb8-4935-af47-c647fb5443b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.005774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f47beb-bcb8-4935-af47-c647fb5443b0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.007252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2638d-aee5-43f0-92e7-97e98da34bf3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.052374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 902/1804] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:39 2022] POST /identity/v3/projects => generated 357 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:40.053960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87e03-e0a8-4ea2-a46e-41f06ef73ffa None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.054311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87e03-e0a8-4ea2-a46e-41f06ef73ffa None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.054612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87e03-e0a8-4ea2-a46e-41f06ef73ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.067877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 903/1805] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:39 2022] POST /identity/v3/projects => generated 387 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:40.070361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f47beb-bcb8-4935-af47-c647fb5443b0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.073967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c6f47beb-bcb8-4935-af47-c647fb5443b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.080443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-79a87e03-e0a8-4ea2-a46e-41f06ef73ffa None None] MFA Rules not processed for user `2d3018419d0548eda04b3539681f3df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:40.081839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-79a87e03-e0a8-4ea2-a46e-41f06ef73ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.191861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 903/1806] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 15:59:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:40.192932 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a87e03-e0a8-4ea2-a46e-41f06ef73ffa None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.195049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-79a87e03-e0a8-4ea2-a46e-41f06ef73ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.291602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f47beb-bcb8-4935-af47-c647fb5443b0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.299934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd2c5-7958-49b4-a031-ce637b3d9d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:40.301091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd2c5-7958-49b4-a031-ce637b3d9d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.301723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd2c5-7958-49b4-a031-ce637b3d9d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.302167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd2c5-7958-49b4-a031-ce637b3d9d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.303152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdd2c5-7958-49b4-a031-ce637b3d9d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.305174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdd2c5-7958-49b4-a031-ce637b3d9d08 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.330108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 904/1807] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:40.331518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b3d2a-f5aa-4a7d-badd-dd6f6711c0bd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.331811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b3d2a-f5aa-4a7d-badd-dd6f6711c0bd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.332091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b3d2a-f5aa-4a7d-badd-dd6f6711c0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.356616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6c4b3d2a-f5aa-4a7d-badd-dd6f6711c0bd None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:40.358265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6c4b3d2a-f5aa-4a7d-badd-dd6f6711c0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.380566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 905/1808] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:40.393191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b3d2a-f5aa-4a7d-badd-dd6f6711c0bd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.394932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6c4b3d2a-f5aa-4a7d-badd-dd6f6711c0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.404488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a87e03-e0a8-4ea2-a46e-41f06ef73ffa None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.409797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b3d2a-f5aa-4a7d-badd-dd6f6711c0bd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.411482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb353-3cf2-427c-902a-3e61da6f93b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:40.412670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb353-3cf2-427c-902a-3e61da6f93b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.412978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb353-3cf2-427c-902a-3e61da6f93b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.413411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdb353-3cf2-427c-902a-3e61da6f93b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.414265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdb353-3cf2-427c-902a-3e61da6f93b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.417580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:40.418163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdb353-3cf2-427c-902a-3e61da6f93b9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.418891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.419311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.419769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] PATH_INFO: `/v3/projects/625c0522edcc4b9e999207e3e10eb386` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.421314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625c0522edcc4b9e999207e3e10eb386)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.423690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.444169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 904/1809] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:40.444169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb353-3cf2-427c-902a-3e61da6f93b9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.464982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdb353-3cf2-427c-902a-3e61da6f93b9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.471642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b910a7-12cb-4a3c-aadc-adb5e6bc7677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:40.472345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b910a7-12cb-4a3c-aadc-adb5e6bc7677 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.473424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b910a7-12cb-4a3c-aadc-adb5e6bc7677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.473957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b910a7-12cb-4a3c-aadc-adb5e6bc7677 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.474796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b910a7-12cb-4a3c-aadc-adb5e6bc7677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.478433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b910a7-12cb-4a3c-aadc-adb5e6bc7677 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.515133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625c0522edcc4b9e999207e3e10eb386', 'request_id': 'req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:40.522907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 905/1810] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:40 2022] POST /identity/v3/users => generated 285 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:40.523965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b910a7-12cb-4a3c-aadc-adb5e6bc7677 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.530027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625c0522edcc4b9e999207e3e10eb386', 'request_id': 'req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:40.539930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b910a7-12cb-4a3c-aadc-adb5e6bc7677 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.540750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625c0522edcc4b9e999207e3e10eb386', 'request_id': 'req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:40.543125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:40.565571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] The token cache is being invalidate because project 625c0522edcc4b9e999207e3e10eb386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:40.566252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:40.567376 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:40.577109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 906/1811] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:40 2022] DELETE /identity/v3/projects/625c0522edcc4b9e999207e3e10eb386 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:40.578533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.580588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.585640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:40.636079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12db6ba-0bd5-4761-bfbb-8056d8f777b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:40.636393 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12db6ba-0bd5-4761-bfbb-8056d8f777b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.636679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12db6ba-0bd5-4761-bfbb-8056d8f777b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.637063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12db6ba-0bd5-4761-bfbb-8056d8f777b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.637873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12db6ba-0bd5-4761-bfbb-8056d8f777b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.640081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12db6ba-0bd5-4761-bfbb-8056d8f777b0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.665854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 906/1812] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:40 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:40.667095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12db6ba-0bd5-4761-bfbb-8056d8f777b0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.669090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e12db6ba-0bd5-4761-bfbb-8056d8f777b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.683295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12db6ba-0bd5-4761-bfbb-8056d8f777b0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.685021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cceaf8-f076-4e78-b47f-bba6ec86f0b0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.688259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17d2b1-ed28-402b-bd2d-2170c6a7ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:40.689059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17d2b1-ed28-402b-bd2d-2170c6a7ce69 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.689428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17d2b1-ed28-402b-bd2d-2170c6a7ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.689785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17d2b1-ed28-402b-bd2d-2170c6a7ce69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.690625 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17d2b1-ed28-402b-bd2d-2170c6a7ce69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.692435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17d2b1-ed28-402b-bd2d-2170c6a7ce69 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.692900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c77aee-c852-4e7a-bd70-7538a47fcad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:40.694108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c77aee-c852-4e7a-bd70-7538a47fcad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.694637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c77aee-c852-4e7a-bd70-7538a47fcad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.695151 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c77aee-c852-4e7a-bd70-7538a47fcad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.700695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62c77aee-c852-4e7a-bd70-7538a47fcad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.706199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 907/1813] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:40.707566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17d2b1-ed28-402b-bd2d-2170c6a7ce69 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.721175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17d2b1-ed28-402b-bd2d-2170c6a7ce69 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.725671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c77aee-c852-4e7a-bd70-7538a47fcad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.725887 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc41ed8-c14e-4953-9b9d-293bdd61ae08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:40.726670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc41ed8-c14e-4953-9b9d-293bdd61ae08 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.727064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc41ed8-c14e-4953-9b9d-293bdd61ae08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.727664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc41ed8-c14e-4953-9b9d-293bdd61ae08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.728635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c77aee-c852-4e7a-bd70-7538a47fcad2 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.730347 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4dc41ed8-c14e-4953-9b9d-293bdd61ae08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.741972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 907/1814] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:40.745017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c77aee-c852-4e7a-bd70-7538a47fcad2 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.745361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc41ed8-c14e-4953-9b9d-293bdd61ae08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.747389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc41ed8-c14e-4953-9b9d-293bdd61ae08 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.748250 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62c77aee-c852-4e7a-bd70-7538a47fcad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.759998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 908/1815] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:40.761321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc41ed8-c14e-4953-9b9d-293bdd61ae08 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.763079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4dc41ed8-c14e-4953-9b9d-293bdd61ae08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.777939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc41ed8-c14e-4953-9b9d-293bdd61ae08 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.781982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c77aee-c852-4e7a-bd70-7538a47fcad2 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.783034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a37f91-ffe7-4288-9921-307cfc9dbd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:40.783891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a37f91-ffe7-4288-9921-307cfc9dbd1b admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.784261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a37f91-ffe7-4288-9921-307cfc9dbd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.784638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a37f91-ffe7-4288-9921-307cfc9dbd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.785489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a37f91-ffe7-4288-9921-307cfc9dbd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.787395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a37f91-ffe7-4288-9921-307cfc9dbd1b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.793669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2ed81-84dd-4429-a949-68a0a2c34b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:40.796139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2ed81-84dd-4429-a949-68a0a2c34b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:40.796541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2ed81-84dd-4429-a949-68a0a2c34b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:40.796898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2ed81-84dd-4429-a949-68a0a2c34b72 admin admin] PATH_INFO: `/v3/projects/9a28588e64754ebaa848ac8a804ebbd5/users/13162f18e9c9492f9c7c32b3e74cdf1a/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:40.801521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 909/1816] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:40.803819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a37f91-ffe7-4288-9921-307cfc9dbd1b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.811228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f3a37f91-ffe7-4288-9921-307cfc9dbd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.828154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2ed81-84dd-4429-a949-68a0a2c34b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a28588e64754ebaa848ac8a804ebbd5, user_id=13162f18e9c9492f9c7c32b3e74cdf1a, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:40.831131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2ed81-84dd-4429-a949-68a0a2c34b72 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:40.850116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 908/1817] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:40 2022] PUT /identity/v3/projects/9a28588e64754ebaa848ac8a804ebbd5/users/13162f18e9c9492f9c7c32b3e74cdf1a/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:40.851216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2ed81-84dd-4429-a949-68a0a2c34b72 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:40.851373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a37f91-ffe7-4288-9921-307cfc9dbd1b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:40.854691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-71c2ed81-84dd-4429-a949-68a0a2c34b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:40.999321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:41.002979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:41.005287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2ed81-84dd-4429-a949-68a0a2c34b72 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:41.005688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:41.006133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] PATH_INFO: `/v3/users/312225690deb4370b2c91fe172bcb2ea` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:41.010288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=312225690deb4370b2c91fe172bcb2ea)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:41.012778 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:41.016186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544a361-facb-4dd3-9cc5-b0a3970410c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:41.018620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544a361-facb-4dd3-9cc5-b0a3970410c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:41.019829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544a361-facb-4dd3-9cc5-b0a3970410c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:41.020675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544a361-facb-4dd3-9cc5-b0a3970410c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:41.024847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544a361-facb-4dd3-9cc5-b0a3970410c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:41.028494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544a361-facb-4dd3-9cc5-b0a3970410c0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:41.081376 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 909/1818] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:41.085773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544a361-facb-4dd3-9cc5-b0a3970410c0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:41.096259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312225690deb4370b2c91fe172bcb2ea'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:41.127214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544a361-facb-4dd3-9cc5-b0a3970410c0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:41.127635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312225690deb4370b2c91fe172bcb2ea'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:41.129097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312225690deb4370b2c91fe172bcb2ea'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:41.149991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724929d9-dd00-4e32-9497-1887c32d250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:41.151677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724929d9-dd00-4e32-9497-1887c32d250f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:41.152167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724929d9-dd00-4e32-9497-1887c32d250f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:41.152668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724929d9-dd00-4e32-9497-1887c32d250f admin admin] PATH_INFO: `/v3/projects/414edfe9beff48599c2b0879ae29586b/users/2204aa6ef41f4d57b6c2f1b0591c9704/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:41.159556 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312225690deb4370b2c91fe172bcb2ea'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:41.160807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312225690deb4370b2c91fe172bcb2ea'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:41.189673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:41.196558 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 910/1819] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:40 2022] DELETE /identity/v3/users/312225690deb4370b2c91fe172bcb2ea => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:41.198958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:41.215688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:41.220076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724929d9-dd00-4e32-9497-1887c32d250f admin admin] RBAC: Authorizing `identity:create_grant(project_id=414edfe9beff48599c2b0879ae29586b, user_id=2204aa6ef41f4d57b6c2f1b0591c9704, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:41.229901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724929d9-dd00-4e32-9497-1887c32d250f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:41.283549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 910/1820] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:41 2022] PUT /identity/v3/projects/414edfe9beff48599c2b0879ae29586b/users/2204aa6ef41f4d57b6c2f1b0591c9704/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:41.285130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724929d9-dd00-4e32-9497-1887c32d250f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:41.293917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-724929d9-dd00-4e32-9497-1887c32d250f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:41.423351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3bdf-257a-414e-a97d-837a8c025d8e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:41.476437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:41.534178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e03fa1-a465-4a48-b209-629523d1aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:41.535325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e03fa1-a465-4a48-b209-629523d1aa68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:41.535731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e03fa1-a465-4a48-b209-629523d1aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:41.536121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e03fa1-a465-4a48-b209-629523d1aa68 admin admin] PATH_INFO: `/v3/projects/8b8c2e96639f49cda735407320beceda/users/f8bdc9d1a0194505ae40d22498cc2f1e/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:41.550369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724929d9-dd00-4e32-9497-1887c32d250f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:41.561028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e03fa1-a465-4a48-b209-629523d1aa68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8c2e96639f49cda735407320beceda, user_id=f8bdc9d1a0194505ae40d22498cc2f1e, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:41.566490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e03fa1-a465-4a48-b209-629523d1aa68 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:41.577004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac43f56-cc0f-422a-95dd-1cada4ca68ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:41.580663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac43f56-cc0f-422a-95dd-1cada4ca68ca admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:41.581548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac43f56-cc0f-422a-95dd-1cada4ca68ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:41.583440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac43f56-cc0f-422a-95dd-1cada4ca68ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:41.584315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac43f56-cc0f-422a-95dd-1cada4ca68ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:41.586679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac43f56-cc0f-422a-95dd-1cada4ca68ca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:41.622777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 911/1821] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:41.623553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac43f56-cc0f-422a-95dd-1cada4ca68ca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:41.632100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1ac43f56-cc0f-422a-95dd-1cada4ca68ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:41.648212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 911/1822] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:41 2022] PUT /identity/v3/projects/8b8c2e96639f49cda735407320beceda/users/f8bdc9d1a0194505ae40d22498cc2f1e/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:41.661643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4430685-2318-4cb9-93cf-0e002ef0eda9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:41.663824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4430685-2318-4cb9-93cf-0e002ef0eda9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:41.666206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4430685-2318-4cb9-93cf-0e002ef0eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:41.679418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac43f56-cc0f-422a-95dd-1cada4ca68ca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:41.760724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d4430685-2318-4cb9-93cf-0e002ef0eda9 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:41.768426 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d4430685-2318-4cb9-93cf-0e002ef0eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:41.844892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354939a4-9d4b-4f39-86d7-745e8839a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:41.845844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354939a4-9d4b-4f39-86d7-745e8839a4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:41.846724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354939a4-9d4b-4f39-86d7-745e8839a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:41.847292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354939a4-9d4b-4f39-86d7-745e8839a4a0 admin admin] PATH_INFO: `/v3/projects/55f8e6c5bc9e4b8fa354a5218db00d18/users/b1e93d3600c94c0596b91942f06a939d/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:41.894820 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354939a4-9d4b-4f39-86d7-745e8839a4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f8e6c5bc9e4b8fa354a5218db00d18, user_id=b1e93d3600c94c0596b91942f06a939d, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:41.898100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354939a4-9d4b-4f39-86d7-745e8839a4a0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:41.922445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 912/1823] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:41 2022] PUT /identity/v3/projects/55f8e6c5bc9e4b8fa354a5218db00d18/users/b1e93d3600c94c0596b91942f06a939d/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:41.923339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354939a4-9d4b-4f39-86d7-745e8839a4a0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:42.043212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 912/1824] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:42.044770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4430685-2318-4cb9-93cf-0e002ef0eda9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:42.088807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4430685-2318-4cb9-93cf-0e002ef0eda9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:42.122794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354939a4-9d4b-4f39-86d7-745e8839a4a0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:42.129924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724f95-5888-4e48-8287-2ad81c5e8e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:42.130929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724f95-5888-4e48-8287-2ad81c5e8e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:42.131282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724f95-5888-4e48-8287-2ad81c5e8e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:42.131649 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724f95-5888-4e48-8287-2ad81c5e8e08 admin admin] PATH_INFO: `/v3/projects/9a28588e64754ebaa848ac8a804ebbd5/users/13162f18e9c9492f9c7c32b3e74cdf1a/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:42.134670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa724f95-5888-4e48-8287-2ad81c5e8e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a28588e64754ebaa848ac8a804ebbd5, user_id=13162f18e9c9492f9c7c32b3e74cdf1a, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:42.139525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa724f95-5888-4e48-8287-2ad81c5e8e08 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:42.196473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 913/1825] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:41 2022] PUT /identity/v3/projects/9a28588e64754ebaa848ac8a804ebbd5/users/13162f18e9c9492f9c7c32b3e74cdf1a/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:42.196473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724f95-5888-4e48-8287-2ad81c5e8e08 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:42.198954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:42.200543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aa724f95-5888-4e48-8287-2ad81c5e8e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:42.262864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b5ea2-e8e1-42c2-a041-645416ca8bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:42.263746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5ea2-e8e1-42c2-a041-645416ca8bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:42.264040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5ea2-e8e1-42c2-a041-645416ca8bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:42.264325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5ea2-e8e1-42c2-a041-645416ca8bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:42.265100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b5ea2-e8e1-42c2-a041-645416ca8bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:42.267197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b5ea2-e8e1-42c2-a041-645416ca8bd8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:42.281109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 913/1826] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:42.282102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b5ea2-e8e1-42c2-a041-645416ca8bd8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:42.298194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b5ea2-e8e1-42c2-a041-645416ca8bd8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:42.306758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:42.314648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724f95-5888-4e48-8287-2ad81c5e8e08 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:42.328252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:42.329875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:42.330176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:42.331149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] PATH_INFO: `/v3/projects/c8185bb16b81470f90c1b7d14af098f9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:42.332899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8185bb16b81470f90c1b7d14af098f9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:42.335965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:42.389199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdd374-7ace-454e-8498-7bf02366456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:42.390083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd374-7ace-454e-8498-7bf02366456a admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:42.393346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd374-7ace-454e-8498-7bf02366456a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:42.393346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd374-7ace-454e-8498-7bf02366456a admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:42.394522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdd374-7ace-454e-8498-7bf02366456a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:42.397015 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdd374-7ace-454e-8498-7bf02366456a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:42.417167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 914/1827] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:42.422181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdd374-7ace-454e-8498-7bf02366456a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:42.424378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6afdd374-7ace-454e-8498-7bf02366456a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:42.437661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8185bb16b81470f90c1b7d14af098f9', 'request_id': 'req-210c99d6-19be-415f-8d4e-661d62f0fbfe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:42.442947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdd374-7ace-454e-8498-7bf02366456a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:42.457987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8185bb16b81470f90c1b7d14af098f9', 'request_id': 'req-210c99d6-19be-415f-8d4e-661d62f0fbfe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:42.475272 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8185bb16b81470f90c1b7d14af098f9', 'request_id': 'req-210c99d6-19be-415f-8d4e-661d62f0fbfe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:42.507130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] The token cache is being invalidate because project c8185bb16b81470f90c1b7d14af098f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:42.507831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:42.509411 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:42.511703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 914/1828] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:42 2022] DELETE /identity/v3/projects/c8185bb16b81470f90c1b7d14af098f9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:42.512850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:42.516034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:42.573515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:42.575617 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:42.575987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:42.576362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] PATH_INFO: `/v3/projects/4b4854badace4cabb1381162daa5c449` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:42.578209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4854badace4cabb1381162daa5c449)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:42.581541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:42.646829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c99d6-19be-415f-8d4e-661d62f0fbfe admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:42.662902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a108d-f88c-4f63-9806-1756aac7eff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:42.664540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a108d-f88c-4f63-9806-1756aac7eff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:42.665730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a108d-f88c-4f63-9806-1756aac7eff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:42.666224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a108d-f88c-4f63-9806-1756aac7eff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:42.669188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da9a108d-f88c-4f63-9806-1756aac7eff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:42.693053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a108d-f88c-4f63-9806-1756aac7eff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:42.696024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a108d-f88c-4f63-9806-1756aac7eff2 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:42.727672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 915/1829] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:42.730271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b14d-5c8a-40cc-a324-5a031acc16f9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:42.732086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b14d-5c8a-40cc-a324-5a031acc16f9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:42.732683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b14d-5c8a-40cc-a324-5a031acc16f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:42.745217 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4854badace4cabb1381162daa5c449', 'request_id': 'req-a9ed817b-67d5-4dd0-a046-f11f05c6b124'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:42.778109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4854badace4cabb1381162daa5c449', 'request_id': 'req-a9ed817b-67d5-4dd0-a046-f11f05c6b124'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:42.796394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:42.812397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4854badace4cabb1381162daa5c449', 'request_id': 'req-a9ed817b-67d5-4dd0-a046-f11f05c6b124'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:42.836581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e475b14d-5c8a-40cc-a324-5a031acc16f9 None None] MFA Rules not processed for user `13162f18e9c9492f9c7c32b3e74cdf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:42.839513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e475b14d-5c8a-40cc-a324-5a031acc16f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:42.848055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] The token cache is being invalidate because project 4b4854badace4cabb1381162daa5c449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:42.848381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:42.849302 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a9ed817b-67d5-4dd0-a046-f11f05c6b124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:42.859620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 915/1830] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:42 2022] DELETE /identity/v3/projects/4b4854badace4cabb1381162daa5c449 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:42.867918 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6bd4d-3ba1-45ba-abcf-91125951d390 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:42.871100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6bd4d-3ba1-45ba-abcf-91125951d390 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:42.872058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6bd4d-3ba1-45ba-abcf-91125951d390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:42.911014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8fa6bd4d-3ba1-45ba-abcf-91125951d390 None None] MFA Rules not processed for user `74f447686a3a41ef8300b20c04c9776a`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:42.912952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8fa6bd4d-3ba1-45ba-abcf-91125951d390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:43.078466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 916/1831] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:43.079887 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6bd4d-3ba1-45ba-abcf-91125951d390 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:43.110331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8fa6bd4d-3ba1-45ba-abcf-91125951d390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:43.132874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 916/1832] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:43.132874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b14d-5c8a-40cc-a324-5a031acc16f9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:43.149747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e475b14d-5c8a-40cc-a324-5a031acc16f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:43.219193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:43.346018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6bd4d-3ba1-45ba-abcf-91125951d390 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:43.360067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431fe5a-7e35-4f5a-9a2b-4fa4ee27eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:43.362066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431fe5a-7e35-4f5a-9a2b-4fa4ee27eb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:43.362736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431fe5a-7e35-4f5a-9a2b-4fa4ee27eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:43.363623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431fe5a-7e35-4f5a-9a2b-4fa4ee27eb63 admin admin] PATH_INFO: `/v3/projects/8b8c2e96639f49cda735407320beceda/users/f8bdc9d1a0194505ae40d22498cc2f1e/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:43.369072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431fe5a-7e35-4f5a-9a2b-4fa4ee27eb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8c2e96639f49cda735407320beceda, user_id=f8bdc9d1a0194505ae40d22498cc2f1e, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:43.375646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431fe5a-7e35-4f5a-9a2b-4fa4ee27eb63 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:43.379872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b14d-5c8a-40cc-a324-5a031acc16f9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:43.399688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20723892-283d-4429-84d9-c042ba7642e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:43.401291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20723892-283d-4429-84d9-c042ba7642e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:43.401835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20723892-283d-4429-84d9-c042ba7642e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:43.402395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20723892-283d-4429-84d9-c042ba7642e1 admin admin] PATH_INFO: `/v3/projects/55f8e6c5bc9e4b8fa354a5218db00d18/users/b1e93d3600c94c0596b91942f06a939d/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:43.406588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20723892-283d-4429-84d9-c042ba7642e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f8e6c5bc9e4b8fa354a5218db00d18, user_id=b1e93d3600c94c0596b91942f06a939d, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:43.411811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20723892-283d-4429-84d9-c042ba7642e1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:43.423059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 917/1833] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:43 2022] PUT /identity/v3/projects/8b8c2e96639f49cda735407320beceda/users/f8bdc9d1a0194505ae40d22498cc2f1e/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:43.425359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04741d-5d2c-43cd-a7d7-57b6229f08a1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:43.426369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04741d-5d2c-43cd-a7d7-57b6229f08a1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:43.426369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04741d-5d2c-43cd-a7d7-57b6229f08a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:43.452214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 917/1834] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:43 2022] PUT /identity/v3/projects/55f8e6c5bc9e4b8fa354a5218db00d18/users/b1e93d3600c94c0596b91942f06a939d/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:43.465637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2f04741d-5d2c-43cd-a7d7-57b6229f08a1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:43.470707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2f04741d-5d2c-43cd-a7d7-57b6229f08a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:43.475855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92655c0-f851-4efc-b77a-326909814e65 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:43.479277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92655c0-f851-4efc-b77a-326909814e65 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:43.480228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92655c0-f851-4efc-b77a-326909814e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:43.558212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a92655c0-f851-4efc-b77a-326909814e65 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:43.560643 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a92655c0-f851-4efc-b77a-326909814e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:43.674566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 918/1835] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:43.676658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04741d-5d2c-43cd-a7d7-57b6229f08a1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:43.685020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2f04741d-5d2c-43cd-a7d7-57b6229f08a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:43.771251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 918/1836] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:43.773046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff6f79-37e4-433e-b5b5-2b0f5a0941fd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:43.773595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff6f79-37e4-433e-b5b5-2b0f5a0941fd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:43.774393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff6f79-37e4-433e-b5b5-2b0f5a0941fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:43.801273 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:43.822805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5aff6f79-37e4-433e-b5b5-2b0f5a0941fd None None] MFA Rules not processed for user `f8bdc9d1a0194505ae40d22498cc2f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:43.824234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5aff6f79-37e4-433e-b5b5-2b0f5a0941fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:43.874489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04741d-5d2c-43cd-a7d7-57b6229f08a1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:43.884816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ee60b-75cb-47f6-8a7c-47435ec39a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:43.887782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee60b-75cb-47f6-8a7c-47435ec39a25 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:43.888564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee60b-75cb-47f6-8a7c-47435ec39a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:43.889225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee60b-75cb-47f6-8a7c-47435ec39a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:43.983593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 919/1837] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:43 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:43.985429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479db260-4668-439f-8db5-cb2b6a6c0370 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:43.985900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479db260-4668-439f-8db5-cb2b6a6c0370 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:43.986350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479db260-4668-439f-8db5-cb2b6a6c0370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.028329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-479db260-4668-439f-8db5-cb2b6a6c0370 None None] MFA Rules not processed for user `b1e93d3600c94c0596b91942f06a939d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:44.030004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-479db260-4668-439f-8db5-cb2b6a6c0370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:44.064675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:44.066194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ee60b-75cb-47f6-8a7c-47435ec39a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:44.069878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ee60b-75cb-47f6-8a7c-47435ec39a25 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:44.111451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 919/1838] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:44.120547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27142b-46a0-4325-93e9-d66a3bd814ec None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:44.121325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27142b-46a0-4325-93e9-d66a3bd814ec None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:44.121870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27142b-46a0-4325-93e9-d66a3bd814ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.151638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 920/1839] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:44.153749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782d99f-707e-448f-a87e-65407161d939 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:44.154276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782d99f-707e-448f-a87e-65407161d939 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:44.156237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782d99f-707e-448f-a87e-65407161d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.193106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fe27142b-46a0-4325-93e9-d66a3bd814ec None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:44.206663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1782d99f-707e-448f-a87e-65407161d939 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:44.206663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1782d99f-707e-448f-a87e-65407161d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:44.214288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fe27142b-46a0-4325-93e9-d66a3bd814ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:44.222537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 921/1840] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:44.226025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8c68-df97-4c85-ae50-167eba0cda29 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:44.226572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8c68-df97-4c85-ae50-167eba0cda29 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:44.228092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8c68-df97-4c85-ae50-167eba0cda29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.264957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-958e8c68-df97-4c85-ae50-167eba0cda29 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:44.267988 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-958e8c68-df97-4c85-ae50-167eba0cda29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:44.289056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 922/1841] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:44.292167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e8c68-df97-4c85-ae50-167eba0cda29 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:44.294583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-958e8c68-df97-4c85-ae50-167eba0cda29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:44.319869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e8c68-df97-4c85-ae50-167eba0cda29 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:44.326826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 920/1842] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:44.330537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce0313-afa0-43e0-9ae2-f2ece17ec757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:44.331248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce0313-afa0-43e0-9ae2-f2ece17ec757 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:44.331540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce0313-afa0-43e0-9ae2-f2ece17ec757 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:44.331822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce0313-afa0-43e0-9ae2-f2ece17ec757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.360307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27142b-46a0-4325-93e9-d66a3bd814ec None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:44.361520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce0313-afa0-43e0-9ae2-f2ece17ec757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:44.364990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce0313-afa0-43e0-9ae2-f2ece17ec757 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:44.393053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 923/1843] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:44 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:44.396300 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce0313-afa0-43e0-9ae2-f2ece17ec757 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:44.419093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce0313-afa0-43e0-9ae2-f2ece17ec757 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:44.425866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27142b-46a0-4325-93e9-d66a3bd814ec None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:44.435458 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c63895-d254-4f11-9158-8c88ab6b6f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:44.436623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c63895-d254-4f11-9158-8c88ab6b6f26 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:44.437270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c63895-d254-4f11-9158-8c88ab6b6f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:44.439010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c63895-d254-4f11-9158-8c88ab6b6f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.440714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bde3b-2e90-4285-a442-3de43779e7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:44.442463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bde3b-2e90-4285-a442-3de43779e7dd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:44.442872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bde3b-2e90-4285-a442-3de43779e7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:44.444122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bde3b-2e90-4285-a442-3de43779e7dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.452486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bde3b-2e90-4285-a442-3de43779e7dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:44.453734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bde3b-2e90-4285-a442-3de43779e7dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:44.457240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bde3b-2e90-4285-a442-3de43779e7dd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:44.478358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c63895-d254-4f11-9158-8c88ab6b6f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:44.488832 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c63895-d254-4f11-9158-8c88ab6b6f26 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:44.518684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 924/1844] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:44.519143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bde3b-2e90-4285-a442-3de43779e7dd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:44.537975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 921/1845] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:44.544366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c63895-d254-4f11-9158-8c88ab6b6f26 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:44.558191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bde3b-2e90-4285-a442-3de43779e7dd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:44.583330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527c37b-ab54-41b6-af4f-cd244751030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:44.589093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c63895-d254-4f11-9158-8c88ab6b6f26 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:44.593997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527c37b-ab54-41b6-af4f-cd244751030f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:44.594855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527c37b-ab54-41b6-af4f-cd244751030f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:44.595384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527c37b-ab54-41b6-af4f-cd244751030f admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.597064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527c37b-ab54-41b6-af4f-cd244751030f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:44.597595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527c37b-ab54-41b6-af4f-cd244751030f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:44.608345 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527c37b-ab54-41b6-af4f-cd244751030f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:44.624150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5e752-5784-4bc9-81ba-ad1fd9766e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:44.624852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5e752-5784-4bc9-81ba-ad1fd9766e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:44.625146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5e752-5784-4bc9-81ba-ad1fd9766e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:44.625430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5e752-5784-4bc9-81ba-ad1fd9766e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.626167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5e752-5784-4bc9-81ba-ad1fd9766e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:44.628266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5e752-5784-4bc9-81ba-ad1fd9766e57 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:44.678783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 925/1846] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:44.678783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527c37b-ab54-41b6-af4f-cd244751030f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:44.710462 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 922/1847] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:44 2022] POST /identity/v3/projects => generated 391 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:44.711916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5e752-5784-4bc9-81ba-ad1fd9766e57 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:44.718024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527c37b-ab54-41b6-af4f-cd244751030f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:44.804268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5e752-5784-4bc9-81ba-ad1fd9766e57 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:44.816994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319ccef-317e-45cb-9c26-29c7acc6f274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:44.817990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319ccef-317e-45cb-9c26-29c7acc6f274 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:44.818464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319ccef-317e-45cb-9c26-29c7acc6f274 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:44.818901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319ccef-317e-45cb-9c26-29c7acc6f274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.840076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7319ccef-317e-45cb-9c26-29c7acc6f274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:44.864090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:44.915333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:44.917900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:44.918544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:44.919143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] PATH_INFO: `/v3/users/476dc40c112f41a183b2a11a5c2ae763` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:44.924501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=476dc40c112f41a183b2a11a5c2ae763)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:44.928870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:45.058516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476dc40c112f41a183b2a11a5c2ae763'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:45.086292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476dc40c112f41a183b2a11a5c2ae763'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:45.092701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:45.106737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476dc40c112f41a183b2a11a5c2ae763'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:45.107280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319ccef-317e-45cb-9c26-29c7acc6f274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:45.107873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476dc40c112f41a183b2a11a5c2ae763'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:45.110895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319ccef-317e-45cb-9c26-29c7acc6f274 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:45.126432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476dc40c112f41a183b2a11a5c2ae763'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:45.132552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 923/1848] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:45.135361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319ccef-317e-45cb-9c26-29c7acc6f274 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:45.137944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7319ccef-317e-45cb-9c26-29c7acc6f274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:45.157010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 926/1849] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:44 2022] DELETE /identity/v3/users/476dc40c112f41a183b2a11a5c2ae763 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:45.158614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:45.166198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:45.383198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319ccef-317e-45cb-9c26-29c7acc6f274 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:45.405835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a321be-3996-4ba2-88ea-4d894a240985 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:45.427977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc460-cab3-4dec-81bc-f64c92dd6823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:45.429117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc460-cab3-4dec-81bc-f64c92dd6823 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:45.429117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc460-cab3-4dec-81bc-f64c92dd6823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:45.429303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc460-cab3-4dec-81bc-f64c92dd6823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:45.429982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffc460-cab3-4dec-81bc-f64c92dd6823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:45.433127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffc460-cab3-4dec-81bc-f64c92dd6823 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:45.528067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 927/1850] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:45 2022] POST /identity/v3/projects => generated 369 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:45.531883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc460-cab3-4dec-81bc-f64c92dd6823 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:45.536639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9bffc460-cab3-4dec-81bc-f64c92dd6823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:45.574582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4a344-6f1b-4c5b-a94a-bb2a1637255f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:45.575717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4a344-6f1b-4c5b-a94a-bb2a1637255f service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:45.577961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4a344-6f1b-4c5b-a94a-bb2a1637255f service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:45.578577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4a344-6f1b-4c5b-a94a-bb2a1637255f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:45.583213 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a1c4a344-6f1b-4c5b-a94a-bb2a1637255f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:45.689987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc460-cab3-4dec-81bc-f64c92dd6823 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:45.701094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38f43c-d1aa-47e9-8f8e-5b2bef146a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:45.702028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38f43c-d1aa-47e9-8f8e-5b2bef146a02 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:45.702321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38f43c-d1aa-47e9-8f8e-5b2bef146a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:45.702602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38f43c-d1aa-47e9-8f8e-5b2bef146a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:45.705585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cd38f43c-d1aa-47e9-8f8e-5b2bef146a02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:45.740400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:45.777367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4a344-6f1b-4c5b-a94a-bb2a1637255f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:45.780767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4a344-6f1b-4c5b-a94a-bb2a1637255f service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:45.816856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 924/1851] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 15:59:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:59:45.819763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4a344-6f1b-4c5b-a94a-bb2a1637255f service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:45.840031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a1c4a344-6f1b-4c5b-a94a-bb2a1637255f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:45.845876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38f43c-d1aa-47e9-8f8e-5b2bef146a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:45.849775 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38f43c-d1aa-47e9-8f8e-5b2bef146a02 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:45.882751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 928/1852] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:45 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:45.886372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7bd01-1af2-420c-a344-aed4b400d92e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:45.886846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7bd01-1af2-420c-a344-aed4b400d92e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:45.890073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7bd01-1af2-420c-a344-aed4b400d92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:45.927947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4a344-6f1b-4c5b-a94a-bb2a1637255f service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:46.068887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-67a7bd01-1af2-420c-a344-aed4b400d92e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:46.072741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-67a7bd01-1af2-420c-a344-aed4b400d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:46.252135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:46.300059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b87ffa-d390-4934-a74d-f019287ed6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:46.319400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b87ffa-d390-4934-a74d-f019287ed6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:46.327653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b87ffa-d390-4934-a74d-f019287ed6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:46.328608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b87ffa-d390-4934-a74d-f019287ed6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:46.337435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b87ffa-d390-4934-a74d-f019287ed6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:46.362154 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b87ffa-d390-4934-a74d-f019287ed6f3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:46.367327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 929/1853] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:46.369832 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7bd01-1af2-420c-a344-aed4b400d92e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:46.382886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7bd01-1af2-420c-a344-aed4b400d92e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:46.417453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6df9-d716-4802-9809-0677d61993a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:46.418694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6df9-d716-4802-9809-0677d61993a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:46.419385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6df9-d716-4802-9809-0677d61993a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:46.419385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6df9-d716-4802-9809-0677d61993a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:46.420243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a6df9-d716-4802-9809-0677d61993a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:46.434368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a6df9-d716-4802-9809-0677d61993a1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:46.470636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 925/1854] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:45 2022] POST /identity/v3/users => generated 296 bytes in 653 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:46.479723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b87ffa-d390-4934-a74d-f019287ed6f3 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:46.507583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 930/1855] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:46 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:46.517553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b87ffa-d390-4934-a74d-f019287ed6f3 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:46.522350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6df9-d716-4802-9809-0677d61993a1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:46.567060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcdcdb-4afb-41fe-9906-eec0950a4aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:46.568203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcdcdb-4afb-41fe-9906-eec0950a4aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:46.574264 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcdcdb-4afb-41fe-9906-eec0950a4aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:46.574891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcdcdb-4afb-41fe-9906-eec0950a4aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:46.577967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcdcdb-4afb-41fe-9906-eec0950a4aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:46.592887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6df9-d716-4802-9809-0677d61993a1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:46.595097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcdcdb-4afb-41fe-9906-eec0950a4aa2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:46.627882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84352042-a272-4fcd-a142-45ca23abd1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:46.629222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84352042-a272-4fcd-a142-45ca23abd1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:46.629633 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84352042-a272-4fcd-a142-45ca23abd1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:46.630024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84352042-a272-4fcd-a142-45ca23abd1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:46.631398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84352042-a272-4fcd-a142-45ca23abd1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:46.634661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84352042-a272-4fcd-a142-45ca23abd1ae admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:46.720988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 926/1856] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:46.724465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcdcdb-4afb-41fe-9906-eec0950a4aa2 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:46.739530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5efcdcdb-4afb-41fe-9906-eec0950a4aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:46.758185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 931/1857] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:46.762432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84352042-a272-4fcd-a142-45ca23abd1ae admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:46.828428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84352042-a272-4fcd-a142-45ca23abd1ae admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:46.883881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6d3c-7488-4c44-88f6-14745b5f2167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:46.887231 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6d3c-7488-4c44-88f6-14745b5f2167 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:46.887912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6d3c-7488-4c44-88f6-14745b5f2167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:46.888339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6d3c-7488-4c44-88f6-14745b5f2167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:46.889831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6d3c-7488-4c44-88f6-14745b5f2167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:46.893763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6d3c-7488-4c44-88f6-14745b5f2167 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:46.986324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 932/1858] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:46.987269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6d3c-7488-4c44-88f6-14745b5f2167 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:47.008782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcdcdb-4afb-41fe-9906-eec0950a4aa2 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:47.040312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6d3c-7488-4c44-88f6-14745b5f2167 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:47.063616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064097ab-f79f-4957-b417-80571eb5fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:47.064313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064097ab-f79f-4957-b417-80571eb5fcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:47.064602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064097ab-f79f-4957-b417-80571eb5fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:47.064887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064097ab-f79f-4957-b417-80571eb5fcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:47.065645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064097ab-f79f-4957-b417-80571eb5fcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:47.067337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064097ab-f79f-4957-b417-80571eb5fcd7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:47.072903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45ca19-6d3e-4a95-aec1-6ba475772aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:47.073611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45ca19-6d3e-4a95-aec1-6ba475772aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:47.080958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45ca19-6d3e-4a95-aec1-6ba475772aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:47.081420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45ca19-6d3e-4a95-aec1-6ba475772aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:47.125210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 933/1859] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:47.125210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064097ab-f79f-4957-b417-80571eb5fcd7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:47.142901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45ca19-6d3e-4a95-aec1-6ba475772aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:47.146247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064097ab-f79f-4957-b417-80571eb5fcd7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:47.149392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45ca19-6d3e-4a95-aec1-6ba475772aa3 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:47.198437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b9a16-2437-4f66-9736-44e2a59ce17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:47.199392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b9a16-2437-4f66-9736-44e2a59ce17a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:47.199681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b9a16-2437-4f66-9736-44e2a59ce17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:47.200011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b9a16-2437-4f66-9736-44e2a59ce17a admin admin] PATH_INFO: `/v3/projects/42ee647f01a64f538a7d1a1423a306c9/users/1c05a4c1ca13411c82950e381ca30739/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:47.213876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 927/1860] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:47.217121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45ca19-6d3e-4a95-aec1-6ba475772aa3 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:47.279041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b9a16-2437-4f66-9736-44e2a59ce17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ee647f01a64f538a7d1a1423a306c9, user_id=1c05a4c1ca13411c82950e381ca30739, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:47.300712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b9a16-2437-4f66-9736-44e2a59ce17a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:47.325713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45ca19-6d3e-4a95-aec1-6ba475772aa3 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:47.377712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895056c3-8186-4d24-92b4-de528ec652f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:47.381323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895056c3-8186-4d24-92b4-de528ec652f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:47.382113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895056c3-8186-4d24-92b4-de528ec652f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:47.382435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895056c3-8186-4d24-92b4-de528ec652f8 admin admin] PATH_INFO: `/v3/projects/ddbb0be676db47328907aa943e8df545/users/e06bb4a722b34223b60bdbe6ce1e761e/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:47.388083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 934/1861] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:47 2022] PUT /identity/v3/projects/42ee647f01a64f538a7d1a1423a306c9/users/1c05a4c1ca13411c82950e381ca30739/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:47.390469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a5b7a-6228-4c52-84a1-6ad6c7b91862 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:47.391100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a5b7a-6228-4c52-84a1-6ad6c7b91862 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:47.391756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a5b7a-6228-4c52-84a1-6ad6c7b91862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:47.497499 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895056c3-8186-4d24-92b4-de528ec652f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddbb0be676db47328907aa943e8df545, user_id=e06bb4a722b34223b60bdbe6ce1e761e, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:47.501805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895056c3-8186-4d24-92b4-de528ec652f8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:47.520886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5b9a5b7a-6228-4c52-84a1-6ad6c7b91862 None None] MFA Rules not processed for user `2d3018419d0548eda04b3539681f3df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:47.522261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5b9a5b7a-6228-4c52-84a1-6ad6c7b91862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:47.569405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 928/1862] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:47 2022] PUT /identity/v3/projects/ddbb0be676db47328907aa943e8df545/users/e06bb4a722b34223b60bdbe6ce1e761e/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:47.580853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d44693-9143-4623-9c25-1d08030ce7a9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:47.582386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d44693-9143-4623-9c25-1d08030ce7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:47.582970 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d44693-9143-4623-9c25-1d08030ce7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:47.819444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 935/1863] 10.222.0.99 () {58 vars in 1015 bytes} [Tue Jun 21 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:47.824024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0ee7a-1151-4498-906d-b1bda48d4164 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:47.824322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0ee7a-1151-4498-906d-b1bda48d4164 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:47.824617 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0ee7a-1151-4498-906d-b1bda48d4164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:48.042133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-22e0ee7a-1151-4498-906d-b1bda48d4164 None None] MFA Rules not processed for user `e06bb4a722b34223b60bdbe6ce1e761e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:48.044850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22e0ee7a-1151-4498-906d-b1bda48d4164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:48.294337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:48.341027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 936/1864] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:48.342607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3cde1-e4a1-41f0-a1c4-54c2642c1bab None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:48.342907 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3cde1-e4a1-41f0-a1c4-54c2642c1bab None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:48.343213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3cde1-e4a1-41f0-a1c4-54c2642c1bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:48.427829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b2f3cde1-e4a1-41f0-a1c4-54c2642c1bab None None] MFA Rules not processed for user `2204aa6ef41f4d57b6c2f1b0591c9704`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:48.429667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2f3cde1-e4a1-41f0-a1c4-54c2642c1bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:48.433565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-69d44693-9143-4623-9c25-1d08030ce7a9 None None] MFA Rules not processed for user `1c05a4c1ca13411c82950e381ca30739`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:48.442127 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-69d44693-9143-4623-9c25-1d08030ce7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:48.592536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:48.713697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 929/1865] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 1143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:48.715484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d44693-9143-4623-9c25-1d08030ce7a9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:48.782768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 937/1866] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:48.786440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3cde1-e4a1-41f0-a1c4-54c2642c1bab None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:48.975371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d44693-9143-4623-9c25-1d08030ce7a9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:48.990284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e2d8b-5c3f-4e6a-8216-a3d05e69cdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:48.991294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e2d8b-5c3f-4e6a-8216-a3d05e69cdaa service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:48.992023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e2d8b-5c3f-4e6a-8216-a3d05e69cdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:48.993226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e2d8b-5c3f-4e6a-8216-a3d05e69cdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:49.026078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e2d8b-5c3f-4e6a-8216-a3d05e69cdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:49.034444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e2d8b-5c3f-4e6a-8216-a3d05e69cdaa service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:49.056385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3cde1-e4a1-41f0-a1c4-54c2642c1bab None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:49.093855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 930/1867] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:49.096299 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af5591-f6a7-4ec7-89e1-7a532e3d3d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:49.096812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e2d8b-5c3f-4e6a-8216-a3d05e69cdaa service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:49.105323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5591-f6a7-4ec7-89e1-7a532e3d3d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:49.105848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5591-f6a7-4ec7-89e1-7a532e3d3d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:49.106383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5591-f6a7-4ec7-89e1-7a532e3d3d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:49.121024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af5591-f6a7-4ec7-89e1-7a532e3d3d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:49.131865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e2d8b-5c3f-4e6a-8216-a3d05e69cdaa service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:49.134664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af5591-f6a7-4ec7-89e1-7a532e3d3d9b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:49.153503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af6832-6ae9-4b08-bffe-b0ebac548a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:49.155087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af6832-6ae9-4b08-bffe-b0ebac548a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:49.155538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af6832-6ae9-4b08-bffe-b0ebac548a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:49.159229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af6832-6ae9-4b08-bffe-b0ebac548a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:49.163208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af6832-6ae9-4b08-bffe-b0ebac548a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:49.183764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af6832-6ae9-4b08-bffe-b0ebac548a57 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:49.293453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 938/1868] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:48 2022] POST /identity/v3/projects => generated 369 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:49.296230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af5591-f6a7-4ec7-89e1-7a532e3d3d9b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:49.310429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-27af5591-f6a7-4ec7-89e1-7a532e3d3d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:49.318442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 931/1869] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:49 2022] POST /identity/v3/projects => generated 393 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:49.318442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af6832-6ae9-4b08-bffe-b0ebac548a57 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:49.684811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af6832-6ae9-4b08-bffe-b0ebac548a57 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:49.697788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af5591-f6a7-4ec7-89e1-7a532e3d3d9b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:49.714144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d617b-2779-4ee9-80ad-3b31c653c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:49.715607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d617b-2779-4ee9-80ad-3b31c653c540 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:49.720330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d617b-2779-4ee9-80ad-3b31c653c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:49.724822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5592525-c3a5-4170-a3d8-05438d9fdf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:49.725713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d617b-2779-4ee9-80ad-3b31c653c540 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:49.725924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5592525-c3a5-4170-a3d8-05438d9fdf5a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:49.732086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d617b-2779-4ee9-80ad-3b31c653c540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:49.736652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5592525-c3a5-4170-a3d8-05438d9fdf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:49.740738 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5592525-c3a5-4170-a3d8-05438d9fdf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:49.743433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d617b-2779-4ee9-80ad-3b31c653c540 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:49.768627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5592525-c3a5-4170-a3d8-05438d9fdf5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:49.795279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5592525-c3a5-4170-a3d8-05438d9fdf5a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:49.835256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:49.879530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 932/1870] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:49 2022] POST /identity/v3/users => generated 291 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:49.881500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d617b-2779-4ee9-80ad-3b31c653c540 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:49.942583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 939/1871] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:49 2022] POST /identity/v3/projects => generated 373 bytes in 648 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:49.944239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5592525-c3a5-4170-a3d8-05438d9fdf5a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:49.989482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d617b-2779-4ee9-80ad-3b31c653c540 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:50.275032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:50.342930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5592525-c3a5-4170-a3d8-05438d9fdf5a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:50.356693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7222db-d47b-42c9-b86a-2e2be4c71b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:50.357529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7222db-d47b-42c9-b86a-2e2be4c71b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:50.357825 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7222db-d47b-42c9-b86a-2e2be4c71b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:50.358110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7222db-d47b-42c9-b86a-2e2be4c71b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:50.358987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7222db-d47b-42c9-b86a-2e2be4c71b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:50.360647 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca2eae-2ade-405f-8f90-6aa0113a5d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:50.360940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7222db-d47b-42c9-b86a-2e2be4c71b8d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:50.367549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca2eae-2ade-405f-8f90-6aa0113a5d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:50.375452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca2eae-2ade-405f-8f90-6aa0113a5d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:50.375452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca2eae-2ade-405f-8f90-6aa0113a5d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:50.375452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca2eae-2ade-405f-8f90-6aa0113a5d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:50.393904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 940/1872] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:50.398229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7222db-d47b-42c9-b86a-2e2be4c71b8d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:50.420686 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca2eae-2ade-405f-8f90-6aa0113a5d96 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:50.441617 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7222db-d47b-42c9-b86a-2e2be4c71b8d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:50.461104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f7c2c-924e-40d2-a26b-88ba1c9c482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:50.462512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f7c2c-924e-40d2-a26b-88ba1c9c482a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:50.462898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f7c2c-924e-40d2-a26b-88ba1c9c482a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:50.463443 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f7c2c-924e-40d2-a26b-88ba1c9c482a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:50.464202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f7c2c-924e-40d2-a26b-88ba1c9c482a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:50.466321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f7c2c-924e-40d2-a26b-88ba1c9c482a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:50.528188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 941/1873] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:50 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:50.529433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f7c2c-924e-40d2-a26b-88ba1c9c482a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:50.533094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f06f7c2c-924e-40d2-a26b-88ba1c9c482a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:50.553526 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 933/1874] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:49 2022] POST /identity/v3/users => generated 303 bytes in 674 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:50.558937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca2eae-2ade-405f-8f90-6aa0113a5d96 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:50.564941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f7c2c-924e-40d2-a26b-88ba1c9c482a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:50.565688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-86ca2eae-2ade-405f-8f90-6aa0113a5d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:50.579230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:50.580141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:50.580446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:50.580800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] PATH_INFO: `/v3/projects/9b6b40a49de34452960ba5ef338674f5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:50.582509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6b40a49de34452960ba5ef338674f5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:50.584782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:50.644880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca2eae-2ade-405f-8f90-6aa0113a5d96 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:50.676591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:50.681834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:50.682874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:50.683710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] PATH_INFO: `/v3/users/828e168d00314cf2bde9922466a291d8` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:50.687104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=828e168d00314cf2bde9922466a291d8)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:50.693976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:50.733311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6b40a49de34452960ba5ef338674f5', 'request_id': 'req-385466b5-625b-4a7e-a8ee-207dfab4218d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:50.756770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6b40a49de34452960ba5ef338674f5', 'request_id': 'req-385466b5-625b-4a7e-a8ee-207dfab4218d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:50.780774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6b40a49de34452960ba5ef338674f5', 'request_id': 'req-385466b5-625b-4a7e-a8ee-207dfab4218d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:50.815891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] The token cache is being invalidate because project 9b6b40a49de34452960ba5ef338674f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:50.817639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:50.819054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:50.844408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 942/1875] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:50 2022] DELETE /identity/v3/projects/9b6b40a49de34452960ba5ef338674f5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:50.848485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:50.855384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:50.902837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828e168d00314cf2bde9922466a291d8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:50.952817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828e168d00314cf2bde9922466a291d8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:50.955001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828e168d00314cf2bde9922466a291d8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:50.981147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828e168d00314cf2bde9922466a291d8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:50.983687 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828e168d00314cf2bde9922466a291d8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:51.046904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:51.049771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 934/1876] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:50 2022] DELETE /identity/v3/users/828e168d00314cf2bde9922466a291d8 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:51.051679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:51.057848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:51.089866 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385466b5-625b-4a7e-a8ee-207dfab4218d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:51.359868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e4e6-1d08-4801-a46e-a60a5b5a8a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:51.360579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e4e6-1d08-4801-a46e-a60a5b5a8a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:51.360870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e4e6-1d08-4801-a46e-a60a5b5a8a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:51.361152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e4e6-1d08-4801-a46e-a60a5b5a8a3f admin admin] PATH_INFO: `/v3/projects/3844859b1c624575ab4e524d78db244b/users/54e4858d44344bc8aa3b93d8b9afa410/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:51.364726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa65ce9-6c49-4fc0-8a32-acdf5526e4b3 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:51.392547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690d55d-3a41-4adb-a9fb-f7e1d8a03f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:51.393265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d55d-3a41-4adb-a9fb-f7e1d8a03f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:51.393550 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d55d-3a41-4adb-a9fb-f7e1d8a03f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:51.393829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d55d-3a41-4adb-a9fb-f7e1d8a03f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:51.394586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690d55d-3a41-4adb-a9fb-f7e1d8a03f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:51.396296 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690d55d-3a41-4adb-a9fb-f7e1d8a03f82 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:51.429732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466e4e6-1d08-4801-a46e-a60a5b5a8a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3844859b1c624575ab4e524d78db244b, user_id=54e4858d44344bc8aa3b93d8b9afa410, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:51.434817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466e4e6-1d08-4801-a46e-a60a5b5a8a3f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:51.448930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 935/1877] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:51.464405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690d55d-3a41-4adb-a9fb-f7e1d8a03f82 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:51.468727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b690d55d-3a41-4adb-a9fb-f7e1d8a03f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:51.519895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 943/1878] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:50 2022] PUT /identity/v3/projects/3844859b1c624575ab4e524d78db244b/users/54e4858d44344bc8aa3b93d8b9afa410/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:51.521204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e4e6-1d08-4801-a46e-a60a5b5a8a3f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:51.525264 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690d55d-3a41-4adb-a9fb-f7e1d8a03f82 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:51.536406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7466e4e6-1d08-4801-a46e-a60a5b5a8a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:51.797210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:51.804631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e4e6-1d08-4801-a46e-a60a5b5a8a3f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:51.836561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:51.838143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:51.838620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:51.845162 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] PATH_INFO: `/v3/users/b1e93d3600c94c0596b91942f06a939d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:51.860076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e93d3600c94c0596b91942f06a939d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:51.864338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:51.873147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082f2f2-cb6d-4e34-bb3f-ceb0e1e39d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:51.874239 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082f2f2-cb6d-4e34-bb3f-ceb0e1e39d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:51.874720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082f2f2-cb6d-4e34-bb3f-ceb0e1e39d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:51.875213 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082f2f2-cb6d-4e34-bb3f-ceb0e1e39d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:51.876507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082f2f2-cb6d-4e34-bb3f-ceb0e1e39d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:51.879990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082f2f2-cb6d-4e34-bb3f-ceb0e1e39d48 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:51.918328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 936/1879] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:51.926966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757632-fbcb-4aad-962f-2f7bf7eddfed None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:51.927478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757632-fbcb-4aad-962f-2f7bf7eddfed None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:51.927970 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757632-fbcb-4aad-962f-2f7bf7eddfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:52.038950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e8757632-fbcb-4aad-962f-2f7bf7eddfed None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:52.053160 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e8757632-fbcb-4aad-962f-2f7bf7eddfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:52.080235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e93d3600c94c0596b91942f06a939d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:52.095843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 937/1880] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:52.101538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8757632-fbcb-4aad-962f-2f7bf7eddfed None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:52.124288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e93d3600c94c0596b91942f06a939d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:52.148999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e93d3600c94c0596b91942f06a939d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:52.149600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e93d3600c94c0596b91942f06a939d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:52.155462 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8757632-fbcb-4aad-962f-2f7bf7eddfed None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:52.162627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e93d3600c94c0596b91942f06a939d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:52.167056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:52.174525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 944/1881] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:51 2022] DELETE /identity/v3/users/b1e93d3600c94c0596b91942f06a939d => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:52.178049 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:52.183120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:52.190673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afeec4-84f7-4c3e-a352-cf7e12a90f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:52.199641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afeec4-84f7-4c3e-a352-cf7e12a90f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:52.200173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afeec4-84f7-4c3e-a352-cf7e12a90f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:52.207721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afeec4-84f7-4c3e-a352-cf7e12a90f00 admin admin] PATH_INFO: `/v3/projects/377a8771378f42d8bcd6a8e15795f4a8/users/aa50cc46dd4f4e0a9eef3a5a9db15042/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:52.264229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afeec4-84f7-4c3e-a352-cf7e12a90f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377a8771378f42d8bcd6a8e15795f4a8, user_id=aa50cc46dd4f4e0a9eef3a5a9db15042, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:52.271121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afeec4-84f7-4c3e-a352-cf7e12a90f00 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:52.314104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 938/1882] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:52 2022] PUT /identity/v3/projects/377a8771378f42d8bcd6a8e15795f4a8/users/aa50cc46dd4f4e0a9eef3a5a9db15042/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:52.317074 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afeec4-84f7-4c3e-a352-cf7e12a90f00 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:52.328843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f1afeec4-84f7-4c3e-a352-cf7e12a90f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:52.374363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7792011-5d2d-4b29-8f39-1ce73abccb71 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:52.585824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c4e9c-be64-4c98-896c-e439b5a574f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:52.588217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4e9c-be64-4c98-896c-e439b5a574f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:52.591247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4e9c-be64-4c98-896c-e439b5a574f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:52.592669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c4e9c-be64-4c98-896c-e439b5a574f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:52.596678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c4e9c-be64-4c98-896c-e439b5a574f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:52.602275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c4e9c-be64-4c98-896c-e439b5a574f1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:52.643182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 945/1883] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:52.644925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c4e9c-be64-4c98-896c-e439b5a574f1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:52.653110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-143c4e9c-be64-4c98-896c-e439b5a574f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:52.671345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afeec4-84f7-4c3e-a352-cf7e12a90f00 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:52.692759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f061159-d72f-44ad-9c35-ebd96623382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:52.694906 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f061159-d72f-44ad-9c35-ebd96623382f admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:52.696056 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f061159-d72f-44ad-9c35-ebd96623382f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:52.696556 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f061159-d72f-44ad-9c35-ebd96623382f admin admin] PATH_INFO: `/v3/projects/a0399f634f0e4b648b4966fb562b6b28/users/cf03817858d04c6abcd6163f5f39df53/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:52.775650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f061159-d72f-44ad-9c35-ebd96623382f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0399f634f0e4b648b4966fb562b6b28, user_id=cf03817858d04c6abcd6163f5f39df53, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:52.789496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f061159-d72f-44ad-9c35-ebd96623382f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:52.865532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c4e9c-be64-4c98-896c-e439b5a574f1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:52.882371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 939/1884] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:52 2022] PUT /identity/v3/projects/a0399f634f0e4b648b4966fb562b6b28/users/cf03817858d04c6abcd6163f5f39df53/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:52.888193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f061159-d72f-44ad-9c35-ebd96623382f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:52.907939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0f061159-d72f-44ad-9c35-ebd96623382f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:53.233131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d5b8e-8620-4eb8-9da0-18dc6453c491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:53.237385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d5b8e-8620-4eb8-9da0-18dc6453c491 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:53.240085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d5b8e-8620-4eb8-9da0-18dc6453c491 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:53.241690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d5b8e-8620-4eb8-9da0-18dc6453c491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:53.272119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bf9d5b8e-8620-4eb8-9da0-18dc6453c491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:53.302157 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f061159-d72f-44ad-9c35-ebd96623382f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:53.310601 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc3c6-08c1-4f5b-90f6-c94b8578ae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:53.311544 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc3c6-08c1-4f5b-90f6-c94b8578ae62 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:53.311910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc3c6-08c1-4f5b-90f6-c94b8578ae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:53.312262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc3c6-08c1-4f5b-90f6-c94b8578ae62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:53.313254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffc3c6-08c1-4f5b-90f6-c94b8578ae62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:53.315094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffc3c6-08c1-4f5b-90f6-c94b8578ae62 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:53.344981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d5b8e-8620-4eb8-9da0-18dc6453c491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:53.347509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d5b8e-8620-4eb8-9da0-18dc6453c491 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:53.379037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 940/1885] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:53.384931 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc3c6-08c1-4f5b-90f6-c94b8578ae62 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:53.395905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 946/1886] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:53.399593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d5b8e-8620-4eb8-9da0-18dc6453c491 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:53.419189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc3c6-08c1-4f5b-90f6-c94b8578ae62 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:53.425412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:53.433912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02efef9-d3c3-4f19-b829-84ae545b493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:53.437938 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02efef9-d3c3-4f19-b829-84ae545b493b admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:53.439207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02efef9-d3c3-4f19-b829-84ae545b493b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:53.439764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02efef9-d3c3-4f19-b829-84ae545b493b admin admin] PATH_INFO: `/v3/projects/3844859b1c624575ab4e524d78db244b/users/54e4858d44344bc8aa3b93d8b9afa410/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:53.441826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d5b8e-8620-4eb8-9da0-18dc6453c491 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:53.447654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02efef9-d3c3-4f19-b829-84ae545b493b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3844859b1c624575ab4e524d78db244b, user_id=54e4858d44344bc8aa3b93d8b9afa410, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:53.462149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93e058-0b80-4033-9a5f-4441761f96cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:53.463667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02efef9-d3c3-4f19-b829-84ae545b493b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:53.465193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e058-0b80-4033-9a5f-4441761f96cd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:53.467416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e058-0b80-4033-9a5f-4441761f96cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:53.470954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93e058-0b80-4033-9a5f-4441761f96cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:53.472163 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93e058-0b80-4033-9a5f-4441761f96cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:53.473985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93e058-0b80-4033-9a5f-4441761f96cd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:53.498054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 941/1887] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:53 2022] PUT /identity/v3/projects/3844859b1c624575ab4e524d78db244b/users/54e4858d44344bc8aa3b93d8b9afa410/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:53.499685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff92cb-85b7-4a0b-b70d-264f13cfd016 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:53.500029 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff92cb-85b7-4a0b-b70d-264f13cfd016 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:53.500374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff92cb-85b7-4a0b-b70d-264f13cfd016 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:53.502387 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 942/1888] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 15:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:59:53.503588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff92cb-85b7-4a0b-b70d-264f13cfd016 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:53.514580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 947/1889] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:53.516431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acf23f-36e6-4504-a58d-371645cf5f55 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:53.520668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acf23f-36e6-4504-a58d-371645cf5f55 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:53.521286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acf23f-36e6-4504-a58d-371645cf5f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:53.583010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-28acf23f-36e6-4504-a58d-371645cf5f55 None None] MFA Rules not processed for user `54e4858d44344bc8aa3b93d8b9afa410`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:53.591056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-28acf23f-36e6-4504-a58d-371645cf5f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:53.668899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:53.770630 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 948/1890] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:53.771686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acf23f-36e6-4504-a58d-371645cf5f55 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:53.921194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff92cb-85b7-4a0b-b70d-264f13cfd016 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:53.944988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44bad5-c876-46f6-8065-31de4fe09e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:53.946966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44bad5-c876-46f6-8065-31de4fe09e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:53.948592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44bad5-c876-46f6-8065-31de4fe09e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:53.949113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44bad5-c876-46f6-8065-31de4fe09e94 admin admin] PATH_INFO: `/v3/projects/377a8771378f42d8bcd6a8e15795f4a8/users/aa50cc46dd4f4e0a9eef3a5a9db15042/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:53.953755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44bad5-c876-46f6-8065-31de4fe09e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377a8771378f42d8bcd6a8e15795f4a8, user_id=aa50cc46dd4f4e0a9eef3a5a9db15042, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:53.958835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acf23f-36e6-4504-a58d-371645cf5f55 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:53.959830 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44bad5-c876-46f6-8065-31de4fe09e94 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:53.972395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915b60-4c91-4782-9e46-07b27b4d028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:53.973338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915b60-4c91-4782-9e46-07b27b4d028e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:53.973631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915b60-4c91-4782-9e46-07b27b4d028e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:53.973917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915b60-4c91-4782-9e46-07b27b4d028e admin admin] PATH_INFO: `/v3/projects/a0399f634f0e4b648b4966fb562b6b28/users/cf03817858d04c6abcd6163f5f39df53/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:53.994613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915b60-4c91-4782-9e46-07b27b4d028e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0399f634f0e4b648b4966fb562b6b28, user_id=cf03817858d04c6abcd6163f5f39df53, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:54.011191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915b60-4c91-4782-9e46-07b27b4d028e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:54.032432 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 943/1891] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:53 2022] PUT /identity/v3/projects/377a8771378f42d8bcd6a8e15795f4a8/users/aa50cc46dd4f4e0a9eef3a5a9db15042/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:54.038880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812584-b16b-40d5-b938-8af72a636132 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:54.042128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812584-b16b-40d5-b938-8af72a636132 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:54.043070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812584-b16b-40d5-b938-8af72a636132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:54.072435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 949/1892] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:53 2022] PUT /identity/v3/projects/a0399f634f0e4b648b4966fb562b6b28/users/cf03817858d04c6abcd6163f5f39df53/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:54.075651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915b60-4c91-4782-9e46-07b27b4d028e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:54.082991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-12915b60-4c91-4782-9e46-07b27b4d028e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:54.123856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2f812584-b16b-40d5-b938-8af72a636132 None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:54.126067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2f812584-b16b-40d5-b938-8af72a636132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:54.368327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915b60-4c91-4782-9e46-07b27b4d028e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:54.398691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18937730-3021-4895-b269-78c5c0c70845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:54.401767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18937730-3021-4895-b269-78c5c0c70845 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:54.403902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18937730-3021-4895-b269-78c5c0c70845 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:54.404958 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18937730-3021-4895-b269-78c5c0c70845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:54.491516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 944/1893] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:54.495561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648e52-94b3-47e0-9a31-8e6be75cb556 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:54.497081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648e52-94b3-47e0-9a31-8e6be75cb556 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:54.498257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648e52-94b3-47e0-9a31-8e6be75cb556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:54.559197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:54.616719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c9648e52-94b3-47e0-9a31-8e6be75cb556 None None] MFA Rules not processed for user `cf03817858d04c6abcd6163f5f39df53`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:54.628538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c9648e52-94b3-47e0-9a31-8e6be75cb556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:54.774467 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18937730-3021-4895-b269-78c5c0c70845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:54.781963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18937730-3021-4895-b269-78c5c0c70845 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:54.837318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 950/1894] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:54.847689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18937730-3021-4895-b269-78c5c0c70845 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:54.855459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-18937730-3021-4895-b269-78c5c0c70845 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:54.975105 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18937730-3021-4895-b269-78c5c0c70845 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:55.053925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a6a01-8b88-4167-9336-fe24421f773b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:55.057972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a6a01-8b88-4167-9336-fe24421f773b service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:55.058298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a6a01-8b88-4167-9336-fe24421f773b service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:55.059404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a6a01-8b88-4167-9336-fe24421f773b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:55.084702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 945/1895] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 592 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:55.085679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9648e52-94b3-47e0-9a31-8e6be75cb556 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:55.087623 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a6a01-8b88-4167-9336-fe24421f773b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:55.096784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a6a01-8b88-4167-9336-fe24421f773b service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:55.098593 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c9648e52-94b3-47e0-9a31-8e6be75cb556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:55.128771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 951/1896] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:55.129633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9648e52-94b3-47e0-9a31-8e6be75cb556 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:55.139820 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a6a01-8b88-4167-9336-fe24421f773b service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:55.140219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9174b1-7cb7-4b03-a28c-863bf9e1ec43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:55.140219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9174b1-7cb7-4b03-a28c-863bf9e1ec43 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:55.140219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9174b1-7cb7-4b03-a28c-863bf9e1ec43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:55.140219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9174b1-7cb7-4b03-a28c-863bf9e1ec43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:55.147613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0b9174b1-7cb7-4b03-a28c-863bf9e1ec43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:55.153802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a6a01-8b88-4167-9336-fe24421f773b service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:55.164043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf8351-e599-4de1-825c-3589ecd161e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:55.165516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf8351-e599-4de1-825c-3589ecd161e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:55.166292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf8351-e599-4de1-825c-3589ecd161e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:55.166665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf8351-e599-4de1-825c-3589ecd161e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:55.194841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf8351-e599-4de1-825c-3589ecd161e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:55.196757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf8351-e599-4de1-825c-3589ecd161e0 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:55.228241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:55.237567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 952/1897] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:55.376068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9174b1-7cb7-4b03-a28c-863bf9e1ec43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:55.380302 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9174b1-7cb7-4b03-a28c-863bf9e1ec43 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:55.400479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf8351-e599-4de1-825c-3589ecd161e0 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:55.412292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf8351-e599-4de1-825c-3589ecd161e0 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:55.418524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1008380-0c9b-42f7-9556-cc8cc11cb6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:55.419587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008380-0c9b-42f7-9556-cc8cc11cb6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:55.420073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008380-0c9b-42f7-9556-cc8cc11cb6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:55.420507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008380-0c9b-42f7-9556-cc8cc11cb6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:55.424159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b1008380-0c9b-42f7-9556-cc8cc11cb6f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:55.428481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 946/1898] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:55.497977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90821a-6f3e-4999-aa79-34efef685e3f None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:55.498489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90821a-6f3e-4999-aa79-34efef685e3f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:55.498658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90821a-6f3e-4999-aa79-34efef685e3f None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:55.501512 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 947/1899] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 15:59:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:59:55.521231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f99e9-3fb9-4c04-8ecf-3d9363bdc1e3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:55.521231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f99e9-3fb9-4c04-8ecf-3d9363bdc1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:55.521231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f99e9-3fb9-4c04-8ecf-3d9363bdc1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:55.610901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-176f99e9-3fb9-4c04-8ecf-3d9363bdc1e3 None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:55.623308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-176f99e9-3fb9-4c04-8ecf-3d9363bdc1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:55.657400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 948/1900] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 21 15:59:55.718727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f99e9-3fb9-4c04-8ecf-3d9363bdc1e3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:55.741713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1008380-0c9b-42f7-9556-cc8cc11cb6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:55.748520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1008380-0c9b-42f7-9556-cc8cc11cb6f9 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:55.749564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f99e9-3fb9-4c04-8ecf-3d9363bdc1e3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:55.783435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e9176-11eb-4205-b539-da8df9425fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:55.786020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e9176-11eb-4205-b539-da8df9425fbd service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:55.786649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e9176-11eb-4205-b539-da8df9425fbd service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:55.787397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e9176-11eb-4205-b539-da8df9425fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:55.795202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 953/1901] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:59:55.798363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1008380-0c9b-42f7-9556-cc8cc11cb6f9 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:55.802071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b1008380-0c9b-42f7-9556-cc8cc11cb6f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:55.831633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e9176-11eb-4205-b539-da8df9425fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:55.838623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e9176-11eb-4205-b539-da8df9425fbd service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:55.911513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 949/1902] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:59:56.099060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1008380-0c9b-42f7-9556-cc8cc11cb6f9 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:56.112627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:56.113737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:56.114311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:56.114607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] PATH_INFO: `/v3/projects/55f8e6c5bc9e4b8fa354a5218db00d18` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:56.122050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f8e6c5bc9e4b8fa354a5218db00d18)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:56.124265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:56.179343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e9176-11eb-4205-b539-da8df9425fbd service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:56.183828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-740e9176-11eb-4205-b539-da8df9425fbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:56.222316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e9176-11eb-4205-b539-da8df9425fbd service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:56.248490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:56.251485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:56.251843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:56.251992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:56.252239 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] PATH_INFO: `/v3/projects/5e7ceab97a2e4553a59407a693ad0b2e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:56.269823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7ceab97a2e4553a59407a693ad0b2e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:56.269823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:56.293095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f8e6c5bc9e4b8fa354a5218db00d18', 'request_id': 'req-925b815f-c24c-4dbb-9e76-d5e83e15238e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:56.343410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f8e6c5bc9e4b8fa354a5218db00d18', 'request_id': 'req-925b815f-c24c-4dbb-9e76-d5e83e15238e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:56.373771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f8e6c5bc9e4b8fa354a5218db00d18', 'request_id': 'req-925b815f-c24c-4dbb-9e76-d5e83e15238e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:56.430668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] The token cache is being invalidate because project 55f8e6c5bc9e4b8fa354a5218db00d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:56.431025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:56.436217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-925b815f-c24c-4dbb-9e76-d5e83e15238e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:56.452909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 954/1903] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:55 2022] DELETE /identity/v3/projects/55f8e6c5bc9e4b8fa354a5218db00d18 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:59:56.458268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e9bb-a36a-4fbf-bde3-96d142106b46 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:56.458268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e9bb-a36a-4fbf-bde3-96d142106b46 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:56.460320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e9bb-a36a-4fbf-bde3-96d142106b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:56.504376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7ceab97a2e4553a59407a693ad0b2e', 'request_id': 'req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:56.523340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7ceab97a2e4553a59407a693ad0b2e', 'request_id': 'req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:56.526513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-27f8e9bb-a36a-4fbf-bde3-96d142106b46 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:56.527963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-27f8e9bb-a36a-4fbf-bde3-96d142106b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:56.549837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7ceab97a2e4553a59407a693ad0b2e', 'request_id': 'req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:56.584771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] The token cache is being invalidate because project 5e7ceab97a2e4553a59407a693ad0b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:59:56.584771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:56.587451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:56.592804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 950/1904] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 15:59:56 2022] DELETE /identity/v3/projects/5e7ceab97a2e4553a59407a693ad0b2e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:59:56.599417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:56.602298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:56.775366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 955/1905] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:56.779481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91569271-56d7-4740-b42c-82b709c622cd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:56.782925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91569271-56d7-4740-b42c-82b709c622cd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:56.783798 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91569271-56d7-4740-b42c-82b709c622cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:56.875849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-91569271-56d7-4740-b42c-82b709c622cd None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:56.878895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91569271-56d7-4740-b42c-82b709c622cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:56.901600 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6945b4c-bbaf-41a1-aca4-5b4e7ec27369 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:56.915989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:56.918922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 956/1906] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:56.922137 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91569271-56d7-4740-b42c-82b709c622cd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:56.926069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:56.926669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:56.927347 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] PATH_INFO: `/v3/users/13162f18e9c9492f9c7c32b3e74cdf1a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:56.949562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=13162f18e9c9492f9c7c32b3e74cdf1a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:56.954424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:56.988116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91569271-56d7-4740-b42c-82b709c622cd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:57.028801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf82093-8cef-4ddd-93ee-5f6398880a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:57.033670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82093-8cef-4ddd-93ee-5f6398880a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:57.036698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82093-8cef-4ddd-93ee-5f6398880a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:57.038645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82093-8cef-4ddd-93ee-5f6398880a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:57.041871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf82093-8cef-4ddd-93ee-5f6398880a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:59:57.044844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf82093-8cef-4ddd-93ee-5f6398880a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:57.061662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf82093-8cef-4ddd-93ee-5f6398880a8f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:57.111746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:57.139604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 957/1907] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 15:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:59:57.148885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf82093-8cef-4ddd-93ee-5f6398880a8f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:57.155845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13162f18e9c9492f9c7c32b3e74cdf1a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:57.193285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf82093-8cef-4ddd-93ee-5f6398880a8f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:57.230799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae785658-9300-4575-9d1a-761a17ece202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:57.231676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae785658-9300-4575-9d1a-761a17ece202 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:57.232131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae785658-9300-4575-9d1a-761a17ece202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:57.233274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae785658-9300-4575-9d1a-761a17ece202 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:57.235079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae785658-9300-4575-9d1a-761a17ece202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:57.235887 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13162f18e9c9492f9c7c32b3e74cdf1a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:57.239854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13162f18e9c9492f9c7c32b3e74cdf1a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:57.252321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae785658-9300-4575-9d1a-761a17ece202 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:57.287783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13162f18e9c9492f9c7c32b3e74cdf1a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:57.298641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13162f18e9c9492f9c7c32b3e74cdf1a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:59:57.337834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 958/1908] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:57 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:59:57.338794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 951/1909] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 15:59:56 2022] DELETE /identity/v3/users/13162f18e9c9492f9c7c32b3e74cdf1a => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:59:57.349005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae785658-9300-4575-9d1a-761a17ece202 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:57.352900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ae785658-9300-4575-9d1a-761a17ece202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:57.519650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae785658-9300-4575-9d1a-761a17ece202 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:57.527581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba70e9-dbeb-4abb-bfee-b9cae538410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:57.528421 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba70e9-dbeb-4abb-bfee-b9cae538410d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:57.528779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba70e9-dbeb-4abb-bfee-b9cae538410d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:57.529332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba70e9-dbeb-4abb-bfee-b9cae538410d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:57.530261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba70e9-dbeb-4abb-bfee-b9cae538410d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:57.533290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba70e9-dbeb-4abb-bfee-b9cae538410d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:57.592210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 959/1910] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:57 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:59:57.594785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:57.692030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167579ec-b077-4a42-baab-8291ef6d39fc admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:57.700442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b946e-6f33-431b-bb52-de5a66263b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:57.701476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b946e-6f33-431b-bb52-de5a66263b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:57.702107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b946e-6f33-431b-bb52-de5a66263b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:57.702567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b946e-6f33-431b-bb52-de5a66263b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:57.703747 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b946e-6f33-431b-bb52-de5a66263b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:57.706044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b946e-6f33-431b-bb52-de5a66263b20 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:57.720199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 952/1911] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:57.727291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba70e9-dbeb-4abb-bfee-b9cae538410d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:57.744322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba70e9-dbeb-4abb-bfee-b9cae538410d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:57.751370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d678b-a03b-45e9-ac95-5b6468e76689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:57.752338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d678b-a03b-45e9-ac95-5b6468e76689 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:57.752939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d678b-a03b-45e9-ac95-5b6468e76689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:57.753663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d678b-a03b-45e9-ac95-5b6468e76689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:57.754751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d678b-a03b-45e9-ac95-5b6468e76689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:57.756889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d678b-a03b-45e9-ac95-5b6468e76689 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:57.768462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:57.784698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 960/1912] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:57.787115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b946e-6f33-431b-bb52-de5a66263b20 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:57.842321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b946e-6f33-431b-bb52-de5a66263b20 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:57.884577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4bf7-5e59-47de-b304-f118d9117a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:57.888236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4bf7-5e59-47de-b304-f118d9117a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:57.888873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4bf7-5e59-47de-b304-f118d9117a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:57.889448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4bf7-5e59-47de-b304-f118d9117a4a admin admin] PATH_INFO: `/v3/projects/ef7d79d451b640d6bd410686668d6131/users/faf4e44ebc044016b5c0df885d31afb1/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:57.964652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde4bf7-5e59-47de-b304-f118d9117a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7d79d451b640d6bd410686668d6131, user_id=faf4e44ebc044016b5c0df885d31afb1, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:57.984367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde4bf7-5e59-47de-b304-f118d9117a4a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:58.059257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 953/1913] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:57 2022] PUT /identity/v3/projects/ef7d79d451b640d6bd410686668d6131/users/faf4e44ebc044016b5c0df885d31afb1/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:59:58.068019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff1c47-a799-42d8-8ab6-de9362a75a50 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:58.068550 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff1c47-a799-42d8-8ab6-de9362a75a50 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:58.069072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff1c47-a799-42d8-8ab6-de9362a75a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:58.192294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f0ff1c47-a799-42d8-8ab6-de9362a75a50 None None] MFA Rules not processed for user `faf4e44ebc044016b5c0df885d31afb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:58.194743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f0ff1c47-a799-42d8-8ab6-de9362a75a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:59:58.624853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 961/1914] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 559 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:59:58.634107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4bf7-5e59-47de-b304-f118d9117a4a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:58.807857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4bf7-5e59-47de-b304-f118d9117a4a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:58.815036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147699d3-fac7-4379-b99a-7d3074e52df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:58.816146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147699d3-fac7-4379-b99a-7d3074e52df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:58.816608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147699d3-fac7-4379-b99a-7d3074e52df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:58.817039 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147699d3-fac7-4379-b99a-7d3074e52df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:58.817936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147699d3-fac7-4379-b99a-7d3074e52df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:58.820836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147699d3-fac7-4379-b99a-7d3074e52df3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:58.859953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 954/1915] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 15:59:58 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:58.879339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff1c47-a799-42d8-8ab6-de9362a75a50 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:58.898819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff1c47-a799-42d8-8ab6-de9362a75a50 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:59.131915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69295b2b-2d94-4c5d-8472-6e510480ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:59.133711 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295b2b-2d94-4c5d-8472-6e510480ab2c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:59.134230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295b2b-2d94-4c5d-8472-6e510480ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:59.134701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295b2b-2d94-4c5d-8472-6e510480ab2c admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:59.136167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69295b2b-2d94-4c5d-8472-6e510480ab2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:59.149581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69295b2b-2d94-4c5d-8472-6e510480ab2c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:59.257203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147699d3-fac7-4379-b99a-7d3074e52df3 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:59.270915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 962/1916] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 15:59:58 2022] POST /identity/v3/users => generated 293 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:59:59.285126 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:59:59.307363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147699d3-fac7-4379-b99a-7d3074e52df3 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:59.323020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92685-7cbe-42bb-b9f2-ad18214fdb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:59.324220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92685-7cbe-42bb-b9f2-ad18214fdb28 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:59.324738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92685-7cbe-42bb-b9f2-ad18214fdb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:59.325185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92685-7cbe-42bb-b9f2-ad18214fdb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:59.326475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c92685-7cbe-42bb-b9f2-ad18214fdb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:59.337197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c92685-7cbe-42bb-b9f2-ad18214fdb28 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:59.404280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69295b2b-2d94-4c5d-8472-6e510480ab2c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:59.419789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 955/1917] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:59.449282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69295b2b-2d94-4c5d-8472-6e510480ab2c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:59.517298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24279f-3cff-496a-8525-ee71146cbfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:59.517298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24279f-3cff-496a-8525-ee71146cbfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:59.517298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24279f-3cff-496a-8525-ee71146cbfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:59.517298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24279f-3cff-496a-8525-ee71146cbfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:59.518009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24279f-3cff-496a-8525-ee71146cbfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:59.519296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24279f-3cff-496a-8525-ee71146cbfc9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:59.573075 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 963/1918] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:59:59.574897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92685-7cbe-42bb-b9f2-ad18214fdb28 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:59:59.611721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92685-7cbe-42bb-b9f2-ad18214fdb28 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:59:59.642015 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa841a-2092-4b46-8edf-38dfcd97f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:59:59.643844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa841a-2092-4b46-8edf-38dfcd97f65d admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:59.644358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa841a-2092-4b46-8edf-38dfcd97f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:59.644874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa841a-2092-4b46-8edf-38dfcd97f65d admin admin] PATH_INFO: `/v3/projects/ec7e0c2222cf46a08852464cf0726f6e/users/f6e7d7c90d5c4af091693d7f7a640b1c/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:59.741485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa841a-2092-4b46-8edf-38dfcd97f65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7e0c2222cf46a08852464cf0726f6e, user_id=f6e7d7c90d5c4af091693d7f7a640b1c, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:59:59.757679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa841a-2092-4b46-8edf-38dfcd97f65d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:59:59.839328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 956/1919] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 15:59:59 2022] PUT /identity/v3/projects/ec7e0c2222cf46a08852464cf0726f6e/users/f6e7d7c90d5c4af091693d7f7a640b1c/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:59:59.864563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b68d04-e45d-4ddf-bb99-c38503fb1ff9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:59:59.864817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b68d04-e45d-4ddf-bb99-c38503fb1ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:59:59.865108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b68d04-e45d-4ddf-bb99-c38503fb1ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:59:59.949153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-98b68d04-e45d-4ddf-bb99-c38503fb1ff9 None None] MFA Rules not processed for user `f6e7d7c90d5c4af091693d7f7a640b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:59:59.952357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-98b68d04-e45d-4ddf-bb99-c38503fb1ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:00.242998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa841a-2092-4b46-8edf-38dfcd97f65d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:00.245691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-09fa841a-2092-4b46-8edf-38dfcd97f65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:00.280094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:00.304056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 964/1920] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:00.317970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365bf1f-6326-4eab-a014-d40252190223 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:00.318315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365bf1f-6326-4eab-a014-d40252190223 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:00.318547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365bf1f-6326-4eab-a014-d40252190223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:00.433875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e365bf1f-6326-4eab-a014-d40252190223 None None] MFA Rules not processed for user `aa50cc46dd4f4e0a9eef3a5a9db15042`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:00.435028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e365bf1f-6326-4eab-a014-d40252190223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:00.534643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa841a-2092-4b46-8edf-38dfcd97f65d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:00.554231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:00.555841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:00.556139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:00.556426 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] PATH_INFO: `/v3/projects/9a28588e64754ebaa848ac8a804ebbd5` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:00.576186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a28588e64754ebaa848ac8a804ebbd5)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:00.578347 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:00.696899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 965/1921] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:00.698019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365bf1f-6326-4eab-a014-d40252190223 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:00.719104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365bf1f-6326-4eab-a014-d40252190223 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:00.764105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a28588e64754ebaa848ac8a804ebbd5', 'request_id': 'req-9cc475bd-0477-41a1-85c3-1a047cdf331c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:00.788687 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a28588e64754ebaa848ac8a804ebbd5', 'request_id': 'req-9cc475bd-0477-41a1-85c3-1a047cdf331c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:00.807634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a28588e64754ebaa848ac8a804ebbd5', 'request_id': 'req-9cc475bd-0477-41a1-85c3-1a047cdf331c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:00.843181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] The token cache is being invalidate because project 9a28588e64754ebaa848ac8a804ebbd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:00.852243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:00.855723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9cc475bd-0477-41a1-85c3-1a047cdf331c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:00.858689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 957/1922] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:00 2022] DELETE /identity/v3/projects/9a28588e64754ebaa848ac8a804ebbd5 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:00.866157 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5fe1c-4930-4734-8510-6978213cc29a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:00.866637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5fe1c-4930-4734-8510-6978213cc29a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:00.867032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5fe1c-4930-4734-8510-6978213cc29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:00.952492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-dca5fe1c-4930-4734-8510-6978213cc29a None None] MFA Rules not processed for user `2204aa6ef41f4d57b6c2f1b0591c9704`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:00.959434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dca5fe1c-4930-4734-8510-6978213cc29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:00.973498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eb68c-74a3-4cd2-b657-ee0228bc78b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:00.977631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb68c-74a3-4cd2-b657-ee0228bc78b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:00.998209 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb68c-74a3-4cd2-b657-ee0228bc78b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:00.999435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb68c-74a3-4cd2-b657-ee0228bc78b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:01.001410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eb68c-74a3-4cd2-b657-ee0228bc78b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:01.020130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eb68c-74a3-4cd2-b657-ee0228bc78b7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:01.142782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 966/1923] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:00 2022] POST /identity/v3/projects => generated 385 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:01.148477 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402c6d-1835-4562-a47d-d8f8f28ade16 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:01.150946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402c6d-1835-4562-a47d-d8f8f28ade16 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:01.151361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402c6d-1835-4562-a47d-d8f8f28ade16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:01.154370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 958/1924] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:01.156494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5fe1c-4930-4734-8510-6978213cc29a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:01.160564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dca5fe1c-4930-4734-8510-6978213cc29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:01.180365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5fe1c-4930-4734-8510-6978213cc29a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:01.182237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:01.240058 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e6402c6d-1835-4562-a47d-d8f8f28ade16 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:01.241492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6402c6d-1835-4562-a47d-d8f8f28ade16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:01.326986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63304a-59dd-40fb-a55d-9847a5efb71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:01.328055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63304a-59dd-40fb-a55d-9847a5efb71b admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:01.329635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63304a-59dd-40fb-a55d-9847a5efb71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:01.330113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63304a-59dd-40fb-a55d-9847a5efb71b admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:01.331040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63304a-59dd-40fb-a55d-9847a5efb71b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:01.333613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63304a-59dd-40fb-a55d-9847a5efb71b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:01.378610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 959/1925] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:01 2022] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:01.382168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63304a-59dd-40fb-a55d-9847a5efb71b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:01.421115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63304a-59dd-40fb-a55d-9847a5efb71b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:01.442478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118959c-1d30-4172-b166-8c738f52a78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:01.445153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118959c-1d30-4172-b166-8c738f52a78d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:01.448336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118959c-1d30-4172-b166-8c738f52a78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:01.449717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118959c-1d30-4172-b166-8c738f52a78d admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:01.451876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118959c-1d30-4172-b166-8c738f52a78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:01.458779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118959c-1d30-4172-b166-8c738f52a78d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:01.500166 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 960/1926] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:01.505958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118959c-1d30-4172-b166-8c738f52a78d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:01.537276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 967/1927] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:01.547417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98466a3-74f5-4851-9ddb-020380f1b0bd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:01.547726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98466a3-74f5-4851-9ddb-020380f1b0bd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:01.548055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98466a3-74f5-4851-9ddb-020380f1b0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:01.570862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118959c-1d30-4172-b166-8c738f52a78d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:01.603122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056caa2-2319-47d2-80b9-547d563127b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:01.605840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056caa2-2319-47d2-80b9-547d563127b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:01.609732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056caa2-2319-47d2-80b9-547d563127b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:01.611268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056caa2-2319-47d2-80b9-547d563127b1 admin admin] PATH_INFO: `/v3/projects/e668250481b140c19da9fe8c3f55d7cf/users/9649e24e615f487caaab46395bd41882/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:01.627558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b98466a3-74f5-4851-9ddb-020380f1b0bd None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:01.628917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b98466a3-74f5-4851-9ddb-020380f1b0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:01.670124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 968/1928] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:01.672809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98466a3-74f5-4851-9ddb-020380f1b0bd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:01.683534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056caa2-2319-47d2-80b9-547d563127b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e668250481b140c19da9fe8c3f55d7cf, user_id=9649e24e615f487caaab46395bd41882, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:01.690696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056caa2-2319-47d2-80b9-547d563127b1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:01.693535 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:01.729558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98466a3-74f5-4851-9ddb-020380f1b0bd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:01.736513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 961/1929] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:01 2022] PUT /identity/v3/projects/e668250481b140c19da9fe8c3f55d7cf/users/9649e24e615f487caaab46395bd41882/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:01.740711 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056caa2-2319-47d2-80b9-547d563127b1 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:01.914578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799601-6e83-45e5-8427-6d1a59bd9a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:01.915417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799601-6e83-45e5-8427-6d1a59bd9a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:01.915718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799601-6e83-45e5-8427-6d1a59bd9a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:01.916008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799601-6e83-45e5-8427-6d1a59bd9a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:01.916811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799601-6e83-45e5-8427-6d1a59bd9a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:01.917131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799601-6e83-45e5-8427-6d1a59bd9a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:01.919658 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799601-6e83-45e5-8427-6d1a59bd9a24 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:02.007248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 969/1930] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:02.014716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799601-6e83-45e5-8427-6d1a59bd9a24 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:02.020927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-00799601-6e83-45e5-8427-6d1a59bd9a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:02.074242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056caa2-2319-47d2-80b9-547d563127b1 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:02.085594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ad457-fc4d-4643-aaaa-35eb22ec273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:02.090835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ad457-fc4d-4643-aaaa-35eb22ec273c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:02.091245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ad457-fc4d-4643-aaaa-35eb22ec273c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:02.093248 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ad457-fc4d-4643-aaaa-35eb22ec273c admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:02.093248 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ad457-fc4d-4643-aaaa-35eb22ec273c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:02.094963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ad457-fc4d-4643-aaaa-35eb22ec273c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:02.152485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 962/1931] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:00:02.158041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ad457-fc4d-4643-aaaa-35eb22ec273c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:02.198584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ad457-fc4d-4643-aaaa-35eb22ec273c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:02.223737 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfd68c-7f4e-4160-958c-acec5b1bb02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:02.234899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfd68c-7f4e-4160-958c-acec5b1bb02b admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:02.238232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfd68c-7f4e-4160-958c-acec5b1bb02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:02.238793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfd68c-7f4e-4160-958c-acec5b1bb02b admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:02.239448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfd68c-7f4e-4160-958c-acec5b1bb02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:02.241624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfd68c-7f4e-4160-958c-acec5b1bb02b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:02.317041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799601-6e83-45e5-8427-6d1a59bd9a24 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:02.341916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 963/1932] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:02 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:02.341916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfd68c-7f4e-4160-958c-acec5b1bb02b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:02.349999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb51f4d-71d1-4650-8337-942e70ba64b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:02.350688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb51f4d-71d1-4650-8337-942e70ba64b9 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:02.350981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb51f4d-71d1-4650-8337-942e70ba64b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:02.351292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb51f4d-71d1-4650-8337-942e70ba64b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:02.357569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dfb51f4d-71d1-4650-8337-942e70ba64b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:02.474606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:02.571882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfd68c-7f4e-4160-958c-acec5b1bb02b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:02.579280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb51f4d-71d1-4650-8337-942e70ba64b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:02.584251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb51f4d-71d1-4650-8337-942e70ba64b9 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:02.604061 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc95df1-d509-4b23-8857-5bdc11778066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:02.605867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc95df1-d509-4b23-8857-5bdc11778066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:02.606089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc95df1-d509-4b23-8857-5bdc11778066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:02.606703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc95df1-d509-4b23-8857-5bdc11778066 admin admin] PATH_INFO: `/v3/projects/e668250481b140c19da9fe8c3f55d7cf/users/9649e24e615f487caaab46395bd41882/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:02.617665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc95df1-d509-4b23-8857-5bdc11778066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e668250481b140c19da9fe8c3f55d7cf, user_id=9649e24e615f487caaab46395bd41882, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:02.627456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc95df1-d509-4b23-8857-5bdc11778066 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:02.637633 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 970/1933] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:02.640718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb51f4d-71d1-4650-8337-942e70ba64b9 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:02.685055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 964/1934] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:02 2022] PUT /identity/v3/projects/e668250481b140c19da9fe8c3f55d7cf/users/9649e24e615f487caaab46395bd41882/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:02.706099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3bde0-0b55-4cfe-b4b9-8445bdc597bd None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:02.707659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb51f4d-71d1-4650-8337-942e70ba64b9 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:02.707837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3bde0-0b55-4cfe-b4b9-8445bdc597bd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:02.707837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3bde0-0b55-4cfe-b4b9-8445bdc597bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:02.779281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2bd3bde0-0b55-4cfe-b4b9-8445bdc597bd None None] MFA Rules not processed for user `9649e24e615f487caaab46395bd41882`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:02.781542 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2bd3bde0-0b55-4cfe-b4b9-8445bdc597bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:02.865452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:03.091547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e68773-f9d2-4792-8955-5c40493d3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:03.097131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e68773-f9d2-4792-8955-5c40493d3d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:03.099965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 965/1935] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:03.102805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3bde0-0b55-4cfe-b4b9-8445bdc597bd None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:03.107153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e68773-f9d2-4792-8955-5c40493d3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:03.107802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e68773-f9d2-4792-8955-5c40493d3d57 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:03.108697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2bd3bde0-0b55-4cfe-b4b9-8445bdc597bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:03.110318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e68773-f9d2-4792-8955-5c40493d3d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:03.123356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e68773-f9d2-4792-8955-5c40493d3d57 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:03.165988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3bde0-0b55-4cfe-b4b9-8445bdc597bd None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:03.182168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:03.185185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:03.185779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:03.186368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] PATH_INFO: `/v3/users/e06bb4a722b34223b60bdbe6ce1e761e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:03.189633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06bb4a722b34223b60bdbe6ce1e761e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:03.196339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:03.197213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 971/1936] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:02 2022] POST /identity/v3/users => generated 290 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:03.198475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e68773-f9d2-4792-8955-5c40493d3d57 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:03.201063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c1e68773-f9d2-4792-8955-5c40493d3d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:03.354418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06bb4a722b34223b60bdbe6ce1e761e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:03.376245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e68773-f9d2-4792-8955-5c40493d3d57 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:03.384760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82186d-2be8-4202-9d5b-0a571321ed16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:03.386987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82186d-2be8-4202-9d5b-0a571321ed16 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:03.386987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82186d-2be8-4202-9d5b-0a571321ed16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:03.386987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82186d-2be8-4202-9d5b-0a571321ed16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:03.393826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06bb4a722b34223b60bdbe6ce1e761e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:03.398809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06bb4a722b34223b60bdbe6ce1e761e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:03.411104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82186d-2be8-4202-9d5b-0a571321ed16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:03.415065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82186d-2be8-4202-9d5b-0a571321ed16 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:03.427858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06bb4a722b34223b60bdbe6ce1e761e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:03.430983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06bb4a722b34223b60bdbe6ce1e761e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:03.442701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 972/1937] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:03.444119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82186d-2be8-4202-9d5b-0a571321ed16 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:03.477852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82186d-2be8-4202-9d5b-0a571321ed16 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:03.484675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 966/1938] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:03 2022] DELETE /identity/v3/users/e06bb4a722b34223b60bdbe6ce1e761e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:03.487212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:03.495481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:03.553374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:03.673530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a820-96ce-4bc9-b39b-481048f20d9b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:03.702439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:03.705846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd6bc7-9207-45c0-bfd1-6c0672da52f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:03.706437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:03.706907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:03.707902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] PATH_INFO: `/v3/users/1c05a4c1ca13411c82950e381ca30739` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:03.711154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6bc7-9207-45c0-bfd1-6c0672da52f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:03.711795 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6bc7-9207-45c0-bfd1-6c0672da52f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:03.712253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6bc7-9207-45c0-bfd1-6c0672da52f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:03.714491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd6bc7-9207-45c0-bfd1-6c0672da52f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:03.715223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c05a4c1ca13411c82950e381ca30739)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:03.721516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd6bc7-9207-45c0-bfd1-6c0672da52f2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:03.722771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:03.747432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 973/1939] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:03.751773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6460392-d7fd-4d28-a5ff-5a3a9db900f0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:03.752533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6460392-d7fd-4d28-a5ff-5a3a9db900f0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:03.755701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6460392-d7fd-4d28-a5ff-5a3a9db900f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:03.807424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e6460392-d7fd-4d28-a5ff-5a3a9db900f0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:03.814474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6460392-d7fd-4d28-a5ff-5a3a9db900f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:03.839566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 974/1940] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:03.841144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6460392-d7fd-4d28-a5ff-5a3a9db900f0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:03.844838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6460392-d7fd-4d28-a5ff-5a3a9db900f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:03.861717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6460392-d7fd-4d28-a5ff-5a3a9db900f0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:03.869828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6facb5-573b-4c23-9e89-5e7570070e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:03.870881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6facb5-573b-4c23-9e89-5e7570070e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:03.871362 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6facb5-573b-4c23-9e89-5e7570070e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:03.871797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6facb5-573b-4c23-9e89-5e7570070e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:03.873556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6facb5-573b-4c23-9e89-5e7570070e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:03.875485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6facb5-573b-4c23-9e89-5e7570070e0d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:03.899133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 975/1941] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:03.901634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6facb5-573b-4c23-9e89-5e7570070e0d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:03.903886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8e6facb5-573b-4c23-9e89-5e7570070e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:03.909267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c05a4c1ca13411c82950e381ca30739'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:03.950572 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c05a4c1ca13411c82950e381ca30739'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:03.955210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c05a4c1ca13411c82950e381ca30739'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:03.974584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c05a4c1ca13411c82950e381ca30739'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:03.975699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c05a4c1ca13411c82950e381ca30739'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:04.014784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 967/1942] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:03 2022] DELETE /identity/v3/users/1c05a4c1ca13411c82950e381ca30739 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:04.015865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:04.018767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:04.052122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:04.074584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6facb5-573b-4c23-9e89-5e7570070e0d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:04.145128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d620775-c9a9-4d7c-aeb6-6dd1458183a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:04.146121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d620775-c9a9-4d7c-aeb6-6dd1458183a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:04.146521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d620775-c9a9-4d7c-aeb6-6dd1458183a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:04.146881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d620775-c9a9-4d7c-aeb6-6dd1458183a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:04.149594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1d620775-c9a9-4d7c-aeb6-6dd1458183a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:04.152904 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abe5db-649f-4ace-bbff-8d7fdc88f2f4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:04.158779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d4d39-b9a9-4660-b801-6d8797eb0a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:04.159759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d4d39-b9a9-4660-b801-6d8797eb0a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:04.160435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d4d39-b9a9-4660-b801-6d8797eb0a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:04.160719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d4d39-b9a9-4660-b801-6d8797eb0a2d admin admin] PATH_INFO: `/v3/projects/f1ae78ac5a3e4c289c54ca9a627f3e29/users/3496055c29d24917bd1a4e956a770e4e/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:04.167436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d620775-c9a9-4d7c-aeb6-6dd1458183a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:04.169335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d620775-c9a9-4d7c-aeb6-6dd1458183a7 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:04.200739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 976/1943] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:04.203274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d1024-6cb4-4b17-9a75-4a2f6d75766d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:04.203840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d1024-6cb4-4b17-9a75-4a2f6d75766d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:04.204314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d1024-6cb4-4b17-9a75-4a2f6d75766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:04.222584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d4d39-b9a9-4660-b801-6d8797eb0a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ae78ac5a3e4c289c54ca9a627f3e29, user_id=3496055c29d24917bd1a4e956a770e4e, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:04.232003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d4d39-b9a9-4660-b801-6d8797eb0a2d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:04.247642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e55d1024-6cb4-4b17-9a75-4a2f6d75766d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:04.249996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e55d1024-6cb4-4b17-9a75-4a2f6d75766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:04.271702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 968/1944] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:04 2022] PUT /identity/v3/projects/f1ae78ac5a3e4c289c54ca9a627f3e29/users/3496055c29d24917bd1a4e956a770e4e/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:04.286421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7176a8-2654-42de-9b12-c8552c1c1984 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:04.291695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7176a8-2654-42de-9b12-c8552c1c1984 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:04.292588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7176a8-2654-42de-9b12-c8552c1c1984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:04.295547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 977/1945] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:04.311628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d1024-6cb4-4b17-9a75-4a2f6d75766d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:04.321028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e55d1024-6cb4-4b17-9a75-4a2f6d75766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:04.372065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d1024-6cb4-4b17-9a75-4a2f6d75766d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:04.397008 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9c7176a8-2654-42de-9b12-c8552c1c1984 None None] MFA Rules not processed for user `3496055c29d24917bd1a4e956a770e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:04.403946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9c7176a8-2654-42de-9b12-c8552c1c1984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:04.472534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:04.504723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3045e8b-2c16-4fe4-a8d1-201db9087244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:04.505048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3045e8b-2c16-4fe4-a8d1-201db9087244 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:04.505226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3045e8b-2c16-4fe4-a8d1-201db9087244 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:04.505405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3045e8b-2c16-4fe4-a8d1-201db9087244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:04.604909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3045e8b-2c16-4fe4-a8d1-201db9087244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:04.604909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3045e8b-2c16-4fe4-a8d1-201db9087244 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:04.609241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 978/1946] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:04.790029 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 969/1947] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:04.791197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3045e8b-2c16-4fe4-a8d1-201db9087244 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:04.810343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3045e8b-2c16-4fe4-a8d1-201db9087244 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:04.838745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774f8b1-bdd6-4522-b436-9673ec4663e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:04.841620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774f8b1-bdd6-4522-b436-9673ec4663e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:04.843253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774f8b1-bdd6-4522-b436-9673ec4663e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:04.844996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774f8b1-bdd6-4522-b436-9673ec4663e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:04.845964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774f8b1-bdd6-4522-b436-9673ec4663e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:04.855672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774f8b1-bdd6-4522-b436-9673ec4663e5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:04.941597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 979/1948] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:04 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:00:04.942872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7176a8-2654-42de-9b12-c8552c1c1984 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:04.979135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7176a8-2654-42de-9b12-c8552c1c1984 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:04.994864 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774f8b1-bdd6-4522-b436-9673ec4663e5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:04.997218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3774f8b1-bdd6-4522-b436-9673ec4663e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:05.071483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:05.157541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774f8b1-bdd6-4522-b436-9673ec4663e5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:05.174055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1858c5a-fe1c-4848-99fa-3ce6eb4ac5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:05.176071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c1ccf-9839-43f2-b033-169736ca73fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:05.176608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858c5a-fe1c-4848-99fa-3ce6eb4ac5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:05.177199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858c5a-fe1c-4848-99fa-3ce6eb4ac5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:05.177755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1858c5a-fe1c-4848-99fa-3ce6eb4ac5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:05.179023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1858c5a-fe1c-4848-99fa-3ce6eb4ac5d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:05.180737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c1ccf-9839-43f2-b033-169736ca73fe service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:05.180961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c1ccf-9839-43f2-b033-169736ca73fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:05.181245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c1ccf-9839-43f2-b033-169736ca73fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:05.186427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cb3c1ccf-9839-43f2-b033-169736ca73fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:05.191276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1858c5a-fe1c-4848-99fa-3ce6eb4ac5d7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:05.285561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 970/1949] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:04 2022] POST /identity/v3/users => generated 297 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:05.287486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1858c5a-fe1c-4848-99fa-3ce6eb4ac5d7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:05.331746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1858c5a-fe1c-4848-99fa-3ce6eb4ac5d7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:05.353634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf8adf-592c-4d2c-a7d8-cd63cc4c39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:05.354893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8adf-592c-4d2c-a7d8-cd63cc4c39b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:05.355439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8adf-592c-4d2c-a7d8-cd63cc4c39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:05.355967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8adf-592c-4d2c-a7d8-cd63cc4c39b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:05.360973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf8adf-592c-4d2c-a7d8-cd63cc4c39b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:05.367804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf8adf-592c-4d2c-a7d8-cd63cc4c39b5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:05.371226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c1ccf-9839-43f2-b033-169736ca73fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:05.373098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c1ccf-9839-43f2-b033-169736ca73fe service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:05.404435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 980/1950] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:05.438365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 971/1951] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:05.438964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c1ccf-9839-43f2-b033-169736ca73fe service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:05.463859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c1ccf-9839-43f2-b033-169736ca73fe service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:05.510107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4669155-34ce-4a52-81f0-b188acef2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:05.512198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669155-34ce-4a52-81f0-b188acef2a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:05.520553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669155-34ce-4a52-81f0-b188acef2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:05.526419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669155-34ce-4a52-81f0-b188acef2a5a admin admin] PATH_INFO: `/v3/projects/3f1a2aba571248f0b2cbb37f75b84d7b/users/eb3084f20b6d452ca600b00ba6f6933f/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:05.589797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4669155-34ce-4a52-81f0-b188acef2a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1a2aba571248f0b2cbb37f75b84d7b, user_id=eb3084f20b6d452ca600b00ba6f6933f, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:05.593496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4669155-34ce-4a52-81f0-b188acef2a5a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:05.628948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 981/1952] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:05 2022] PUT /identity/v3/projects/3f1a2aba571248f0b2cbb37f75b84d7b/users/eb3084f20b6d452ca600b00ba6f6933f/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:05.631474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf8adf-592c-4d2c-a7d8-cd63cc4c39b5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:05.658977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf8adf-592c-4d2c-a7d8-cd63cc4c39b5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:05.730675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4669155-34ce-4a52-81f0-b188acef2a5a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:05.733627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d4669155-34ce-4a52-81f0-b188acef2a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:05.793528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3245d-d9dc-45b5-b9f6-3f1ee52e96b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:05.794541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3245d-d9dc-45b5-b9f6-3f1ee52e96b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:05.795219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3245d-d9dc-45b5-b9f6-3f1ee52e96b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:05.795660 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3245d-d9dc-45b5-b9f6-3f1ee52e96b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:05.796864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3245d-d9dc-45b5-b9f6-3f1ee52e96b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:05.798727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3245d-d9dc-45b5-b9f6-3f1ee52e96b4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:05.812885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 972/1953] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:05.818735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3245d-d9dc-45b5-b9f6-3f1ee52e96b4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:05.843205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3245d-d9dc-45b5-b9f6-3f1ee52e96b4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:05.857532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01699b7-82fa-453b-a09c-da3182c0bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:05.859459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01699b7-82fa-453b-a09c-da3182c0bfef admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:05.860244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01699b7-82fa-453b-a09c-da3182c0bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:05.860806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01699b7-82fa-453b-a09c-da3182c0bfef admin admin] PATH_INFO: `/v3/projects/3f1a2aba571248f0b2cbb37f75b84d7b/users/eb3084f20b6d452ca600b00ba6f6933f/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:05.869875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01699b7-82fa-453b-a09c-da3182c0bfef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1a2aba571248f0b2cbb37f75b84d7b, user_id=eb3084f20b6d452ca600b00ba6f6933f, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:05.882397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01699b7-82fa-453b-a09c-da3182c0bfef admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:05.906881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 973/1954] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:05 2022] PUT /identity/v3/projects/3f1a2aba571248f0b2cbb37f75b84d7b/users/eb3084f20b6d452ca600b00ba6f6933f/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:05.911931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4669155-34ce-4a52-81f0-b188acef2a5a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:05.923118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01699b7-82fa-453b-a09c-da3182c0bfef admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:05.928451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a01699b7-82fa-453b-a09c-da3182c0bfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:05.986310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:06.052683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:06.054340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:06.054826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:06.055369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] PATH_INFO: `/v3/projects/ddbb0be676db47328907aa943e8df545` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:06.062547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddbb0be676db47328907aa943e8df545)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:06.068469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:06.080259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:06.106239 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01699b7-82fa-453b-a09c-da3182c0bfef admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:06.118369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:06.120459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:06.120911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:06.121297 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] PATH_INFO: `/v3/projects/42ee647f01a64f538a7d1a1423a306c9` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:06.123058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ee647f01a64f538a7d1a1423a306c9)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:06.125763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:06.168448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddbb0be676db47328907aa943e8df545', 'request_id': 'req-87d1f135-4cae-4df4-95a4-6df971c5d038'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.182218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddbb0be676db47328907aa943e8df545', 'request_id': 'req-87d1f135-4cae-4df4-95a4-6df971c5d038'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.193520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddbb0be676db47328907aa943e8df545', 'request_id': 'req-87d1f135-4cae-4df4-95a4-6df971c5d038'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.217355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] The token cache is being invalidate because project ddbb0be676db47328907aa943e8df545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:06.217819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.219959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-87d1f135-4cae-4df4-95a4-6df971c5d038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.225846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 982/1955] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:05 2022] DELETE /identity/v3/projects/ddbb0be676db47328907aa943e8df545 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:06.228556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d6c59-c729-47da-b23c-a1851f73fcd7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:06.228959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d6c59-c729-47da-b23c-a1851f73fcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:06.229375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d6c59-c729-47da-b23c-a1851f73fcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:06.257398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ee647f01a64f538a7d1a1423a306c9', 'request_id': 'req-17a999fa-6605-46e5-b0bb-77377804ca37'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.276441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cb2d6c59-c729-47da-b23c-a1851f73fcd7 None None] MFA Rules not processed for user `eb3084f20b6d452ca600b00ba6f6933f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:06.278022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cb2d6c59-c729-47da-b23c-a1851f73fcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:06.278534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ee647f01a64f538a7d1a1423a306c9', 'request_id': 'req-17a999fa-6605-46e5-b0bb-77377804ca37'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.297842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ee647f01a64f538a7d1a1423a306c9', 'request_id': 'req-17a999fa-6605-46e5-b0bb-77377804ca37'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.322724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] The token cache is being invalidate because project 42ee647f01a64f538a7d1a1423a306c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:06.323495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.324668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.328397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 974/1956] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:05 2022] DELETE /identity/v3/projects/42ee647f01a64f538a7d1a1423a306c9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:06.334461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:06.337869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:06.376895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 983/1957] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:06.377922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d6c59-c729-47da-b23c-a1851f73fcd7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:06.379737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cb2d6c59-c729-47da-b23c-a1851f73fcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:06.506854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a999fa-6605-46e5-b0bb-77377804ca37 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:06.528900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:06.530564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:06.531276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:06.531845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] PATH_INFO: `/v3/users/54e4858d44344bc8aa3b93d8b9afa410` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:06.533146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d6c59-c729-47da-b23c-a1851f73fcd7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:06.534082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e4858d44344bc8aa3b93d8b9afa410)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:06.538073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:06.543797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:06.545280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:06.545777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:06.546284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] PATH_INFO: `/v3/users/cf03817858d04c6abcd6163f5f39df53` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:06.548759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf03817858d04c6abcd6163f5f39df53)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:06.552686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:06.605354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:06.670983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e4858d44344bc8aa3b93d8b9afa410'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.676187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:06.703463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf03817858d04c6abcd6163f5f39df53'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.706357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e4858d44344bc8aa3b93d8b9afa410'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.707909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e4858d44344bc8aa3b93d8b9afa410'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.724447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e4858d44344bc8aa3b93d8b9afa410'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.725975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e4858d44344bc8aa3b93d8b9afa410'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.738938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf03817858d04c6abcd6163f5f39df53'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.755081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf03817858d04c6abcd6163f5f39df53'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.756211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf03817858d04c6abcd6163f5f39df53'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.762696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 975/1958] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:06 2022] DELETE /identity/v3/users/54e4858d44344bc8aa3b93d8b9afa410 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:06.765661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:06.767674 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf03817858d04c6abcd6163f5f39df53'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:06.769549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:06.775719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 984/1959] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:06 2022] DELETE /identity/v3/users/cf03817858d04c6abcd6163f5f39df53 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:06.874356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02dd26-4faf-4a1a-8f72-1c2af17db980 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:06.982780 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a6023-46d0-469b-b650-a551297c6df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:06.983629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6023-46d0-469b-b650-a551297c6df6 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:06.984054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6023-46d0-469b-b650-a551297c6df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:06.984270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6023-46d0-469b-b650-a551297c6df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:06.986691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-759a6023-46d0-469b-b650-a551297c6df6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:07.075730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a6023-46d0-469b-b650-a551297c6df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:07.077506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a6023-46d0-469b-b650-a551297c6df6 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:07.111224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 976/1960] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:07.729657 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:07.733127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:07.868332 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a6023-46d0-469b-b650-a551297c6df6 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:07.870920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-759a6023-46d0-469b-b650-a551297c6df6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:07.980729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:08.192352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a6023-46d0-469b-b650-a551297c6df6 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:08.218985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:08.239687 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:08.242685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:08.243809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] PATH_INFO: `/v3/projects/3844859b1c624575ab4e524d78db244b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:08.253983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3844859b1c624575ab4e524d78db244b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:08.266394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:08.288429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16263db-b5a9-4551-a401-5736af5fcf06 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:08.314935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:08.325068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:08.330278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:08.330895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] PATH_INFO: `/v3/projects/a0399f634f0e4b648b4966fb562b6b28` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:08.339420 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0399f634f0e4b648b4966fb562b6b28)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:08.343615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:08.475540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0399f634f0e4b648b4966fb562b6b28', 'request_id': 'req-cc81a87e-299e-41c9-a012-e1b91952cd64'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:08.496889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0399f634f0e4b648b4966fb562b6b28', 'request_id': 'req-cc81a87e-299e-41c9-a012-e1b91952cd64'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:08.498751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:08.512113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0399f634f0e4b648b4966fb562b6b28', 'request_id': 'req-cc81a87e-299e-41c9-a012-e1b91952cd64'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:08.528984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3844859b1c624575ab4e524d78db244b', 'request_id': 'req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:08.555543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] The token cache is being invalidate because project a0399f634f0e4b648b4966fb562b6b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:08.556273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:08.560967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:08.566789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 985/1961] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:07 2022] DELETE /identity/v3/projects/a0399f634f0e4b648b4966fb562b6b28 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:08.569517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:08.572984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3844859b1c624575ab4e524d78db244b', 'request_id': 'req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:08.578016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:08.607129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3844859b1c624575ab4e524d78db244b', 'request_id': 'req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:08.631439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] The token cache is being invalidate because project 3844859b1c624575ab4e524d78db244b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:08.631895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:08.634013 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-9478bdd1-5c03-4a8c-b5c9-58a32d18b1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:08.644098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 977/1962] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:07 2022] DELETE /identity/v3/projects/3844859b1c624575ab4e524d78db244b => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:08.644098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125f2d1-14c0-46f4-96f5-eecdeae7d837 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:08.644098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125f2d1-14c0-46f4-96f5-eecdeae7d837 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:08.644612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125f2d1-14c0-46f4-96f5-eecdeae7d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:08.771148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a87e-299e-41c9-a012-e1b91952cd64 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:08.799695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-7125f2d1-14c0-46f4-96f5-eecdeae7d837 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:08.802157 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7125f2d1-14c0-46f4-96f5-eecdeae7d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:08.930231 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:08.931186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:08.931487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:08.931771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] PATH_INFO: `/v3/users/3496055c29d24917bd1a4e956a770e4e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:08.936186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3496055c29d24917bd1a4e956a770e4e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:08.938326 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:08.959078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 978/1963] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:08.962216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724fcec-2814-45be-b25a-5db2eeef3a76 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:08.962717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724fcec-2814-45be-b25a-5db2eeef3a76 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:08.963314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724fcec-2814-45be-b25a-5db2eeef3a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:09.008396 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c724fcec-2814-45be-b25a-5db2eeef3a76 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:09.010122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c724fcec-2814-45be-b25a-5db2eeef3a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:09.021325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 979/1964] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:09.022829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb7164-b5c8-4df6-ab3d-ce5cf4a93954 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:09.023862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb7164-b5c8-4df6-ab3d-ce5cf4a93954 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:09.024217 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb7164-b5c8-4df6-ab3d-ce5cf4a93954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:09.062722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4feb7164-b5c8-4df6-ab3d-ce5cf4a93954 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:09.064520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4feb7164-b5c8-4df6-ab3d-ce5cf4a93954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:09.084274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 980/1965] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:09.087136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c578-e7c3-463c-a178-3d653918c15b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:09.087505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c578-e7c3-463c-a178-3d653918c15b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:09.087753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c578-e7c3-463c-a178-3d653918c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:09.097221 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:09.118705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8cf9c578-e7c3-463c-a178-3d653918c15b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:09.121712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8cf9c578-e7c3-463c-a178-3d653918c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:09.135357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 981/1966] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:09.135764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3496055c29d24917bd1a4e956a770e4e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:09.136522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c578-e7c3-463c-a178-3d653918c15b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:09.150885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c578-e7c3-463c-a178-3d653918c15b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:09.157282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb406fac-e49e-41d3-a170-fbc8c7f0f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:09.158086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb406fac-e49e-41d3-a170-fbc8c7f0f145 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:09.158483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb406fac-e49e-41d3-a170-fbc8c7f0f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:09.158867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb406fac-e49e-41d3-a170-fbc8c7f0f145 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:09.159784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb406fac-e49e-41d3-a170-fbc8c7f0f145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:09.160648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb406fac-e49e-41d3-a170-fbc8c7f0f145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:09.163183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb406fac-e49e-41d3-a170-fbc8c7f0f145 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:09.198493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 982/1967] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:09.202709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb406fac-e49e-41d3-a170-fbc8c7f0f145 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:09.216141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3496055c29d24917bd1a4e956a770e4e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:09.234870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3496055c29d24917bd1a4e956a770e4e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:09.245619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3496055c29d24917bd1a4e956a770e4e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:09.258768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3496055c29d24917bd1a4e956a770e4e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:09.268796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb406fac-e49e-41d3-a170-fbc8c7f0f145 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:09.286374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 986/1968] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:08 2022] DELETE /identity/v3/users/3496055c29d24917bd1a4e956a770e4e => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:09.287878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:09.289818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90009c2-ed33-4424-ad1a-ee4dde938abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:09.291688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90009c2-ed33-4424-ad1a-ee4dde938abc admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:09.292418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90009c2-ed33-4424-ad1a-ee4dde938abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:09.293102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90009c2-ed33-4424-ad1a-ee4dde938abc admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:09.294204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:09.295045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90009c2-ed33-4424-ad1a-ee4dde938abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:09.295779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90009c2-ed33-4424-ad1a-ee4dde938abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:09.300791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90009c2-ed33-4424-ad1a-ee4dde938abc admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:09.327527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:09.341718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 983/1969] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:09.346151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9170396-fc46-4303-8aed-904e498dbfcc None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:09.346683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9170396-fc46-4303-8aed-904e498dbfcc None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:09.347212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9170396-fc46-4303-8aed-904e498dbfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:09.411371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a9170396-fc46-4303-8aed-904e498dbfcc None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:09.415208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a9170396-fc46-4303-8aed-904e498dbfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:09.479974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adf4a6-c8b2-4d73-b72f-3e23df6b5a55 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:09.489111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fb716-603a-4e24-a238-4fd7ee52ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:09.490585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb716-603a-4e24-a238-4fd7ee52ec01 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:09.491725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb716-603a-4e24-a238-4fd7ee52ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:09.492412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb716-603a-4e24-a238-4fd7ee52ec01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:09.493722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fb716-603a-4e24-a238-4fd7ee52ec01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:09.498577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fb716-603a-4e24-a238-4fd7ee52ec01 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:09.570012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 987/1970] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:09 2022] POST /identity/v3/projects => generated 383 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:09.572932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fb716-603a-4e24-a238-4fd7ee52ec01 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:09.581879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce1fb716-603a-4e24-a238-4fd7ee52ec01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:09.613670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 984/1971] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:09.615800 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9170396-fc46-4303-8aed-904e498dbfcc None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:09.656983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9170396-fc46-4303-8aed-904e498dbfcc None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:09.825078 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fb716-603a-4e24-a238-4fd7ee52ec01 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:09.834201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079cd62-aac1-40da-8165-9994a95747fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:09.835767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079cd62-aac1-40da-8165-9994a95747fe admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:09.835767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079cd62-aac1-40da-8165-9994a95747fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:09.841276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079cd62-aac1-40da-8165-9994a95747fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:09.842095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079cd62-aac1-40da-8165-9994a95747fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:09.851988 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079cd62-aac1-40da-8165-9994a95747fe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:09.909018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a9d97-fda8-436a-98bc-fe12f2470c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:09.911276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9d97-fda8-436a-98bc-fe12f2470c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:09.911526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 988/1972] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:09 2022] POST /identity/v3/projects => generated 385 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:09.911666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9d97-fda8-436a-98bc-fe12f2470c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:09.911666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9d97-fda8-436a-98bc-fe12f2470c1f admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:09.911910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079cd62-aac1-40da-8165-9994a95747fe admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:09.912647 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a9d97-fda8-436a-98bc-fe12f2470c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:09.918113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a9d97-fda8-436a-98bc-fe12f2470c1f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:09.919892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9079cd62-aac1-40da-8165-9994a95747fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:09.981747 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 985/1973] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:09 2022] POST /identity/v3/users => generated 292 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:09.986790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a9d97-fda8-436a-98bc-fe12f2470c1f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:10.011499 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a9d97-fda8-436a-98bc-fe12f2470c1f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:10.167543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:10.191013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079cd62-aac1-40da-8165-9994a95747fe admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:10.203270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff36cd0-f9be-4739-908c-761315cea591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:10.204307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff36cd0-f9be-4739-908c-761315cea591 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:10.205766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff36cd0-f9be-4739-908c-761315cea591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:10.206072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff36cd0-f9be-4739-908c-761315cea591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:10.251669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dca43-b907-4aa6-b08c-b155efcbae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:10.252507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dca43-b907-4aa6-b08c-b155efcbae2f admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:10.252812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dca43-b907-4aa6-b08c-b155efcbae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:10.253133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dca43-b907-4aa6-b08c-b155efcbae2f admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:10.253860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dca43-b907-4aa6-b08c-b155efcbae2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:10.256172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dca43-b907-4aa6-b08c-b155efcbae2f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:10.273741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:10.316582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 986/1974] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:09 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:10.316582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dca43-b907-4aa6-b08c-b155efcbae2f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:10.352922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dca43-b907-4aa6-b08c-b155efcbae2f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:10.376463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb33ed-b809-4aa1-baf9-deb0efadbd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:10.377818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb33ed-b809-4aa1-baf9-deb0efadbd69 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:10.378333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb33ed-b809-4aa1-baf9-deb0efadbd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:10.378844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb33ed-b809-4aa1-baf9-deb0efadbd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:10.388903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff36cd0-f9be-4739-908c-761315cea591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:10.390388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff36cd0-f9be-4739-908c-761315cea591 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:10.392841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb33ed-b809-4aa1-baf9-deb0efadbd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:10.400466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb33ed-b809-4aa1-baf9-deb0efadbd69 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:10.424746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 989/1975] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:10.427768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff36cd0-f9be-4739-908c-761315cea591 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:10.450965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 987/1976] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:10.453376 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff36cd0-f9be-4739-908c-761315cea591 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:10.458323 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb33ed-b809-4aa1-baf9-deb0efadbd69 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:10.462179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b184bb4-5495-4a36-8ad0-c73c52b7196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:10.463589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b184bb4-5495-4a36-8ad0-c73c52b7196c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:10.463997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b184bb4-5495-4a36-8ad0-c73c52b7196c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:10.464380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b184bb4-5495-4a36-8ad0-c73c52b7196c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:10.465301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b184bb4-5495-4a36-8ad0-c73c52b7196c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:10.469107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b184bb4-5495-4a36-8ad0-c73c52b7196c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:10.488213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 990/1977] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:10.489930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b184bb4-5495-4a36-8ad0-c73c52b7196c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:10.505753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b184bb4-5495-4a36-8ad0-c73c52b7196c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:10.506444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb33ed-b809-4aa1-baf9-deb0efadbd69 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:10.513454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbce22-96b9-44d7-9565-86cfa8856a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:10.514830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbce22-96b9-44d7-9565-86cfa8856a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:10.515416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbce22-96b9-44d7-9565-86cfa8856a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:10.515931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbce22-96b9-44d7-9565-86cfa8856a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:10.518116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbce22-96b9-44d7-9565-86cfa8856a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:10.520466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbce22-96b9-44d7-9565-86cfa8856a6f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:10.532045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877784cf-81f4-4be5-be05-d5b6a2db9e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:10.533411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877784cf-81f4-4be5-be05-d5b6a2db9e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:10.533941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877784cf-81f4-4be5-be05-d5b6a2db9e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:10.534461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877784cf-81f4-4be5-be05-d5b6a2db9e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:10.536016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877784cf-81f4-4be5-be05-d5b6a2db9e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:10.544405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877784cf-81f4-4be5-be05-d5b6a2db9e21 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:10.547518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 991/1978] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:10.552487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbce22-96b9-44d7-9565-86cfa8856a6f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:10.584354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbce22-96b9-44d7-9565-86cfa8856a6f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:10.599554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554e185-de57-4844-9ab8-6d785ab92b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:10.600996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e185-de57-4844-9ab8-6d785ab92b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:10.603869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e185-de57-4844-9ab8-6d785ab92b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:10.604485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554e185-de57-4844-9ab8-6d785ab92b58 admin admin] PATH_INFO: `/v3/projects/d7db6cf0b43049e099b563cda67bb91a/users/45cdaea591df442d8f6e5383794504b7/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:10.609926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 988/1979] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:00:10.622963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877784cf-81f4-4be5-be05-d5b6a2db9e21 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:10.670006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554e185-de57-4844-9ab8-6d785ab92b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7db6cf0b43049e099b563cda67bb91a, user_id=45cdaea591df442d8f6e5383794504b7, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:10.676930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554e185-de57-4844-9ab8-6d785ab92b58 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:10.683084 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877784cf-81f4-4be5-be05-d5b6a2db9e21 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:10.700364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb561d56-0ab7-4125-b598-dcd985a53f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:10.701882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561d56-0ab7-4125-b598-dcd985a53f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:10.702099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561d56-0ab7-4125-b598-dcd985a53f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:10.702426 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb561d56-0ab7-4125-b598-dcd985a53f44 admin admin] PATH_INFO: `/v3/projects/725e038faada422c9ffab287dd601e90/users/e7739b2097524ff8a31720395de4edc5/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:10.747212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 992/1980] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:10 2022] PUT /identity/v3/projects/d7db6cf0b43049e099b563cda67bb91a/users/45cdaea591df442d8f6e5383794504b7/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:10.763556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c81c5-0a08-492a-bfd7-58eb3d08cab7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:10.764240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c81c5-0a08-492a-bfd7-58eb3d08cab7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:10.777673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c81c5-0a08-492a-bfd7-58eb3d08cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:10.779091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561d56-0ab7-4125-b598-dcd985a53f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=725e038faada422c9ffab287dd601e90, user_id=e7739b2097524ff8a31720395de4edc5, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:10.822446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb561d56-0ab7-4125-b598-dcd985a53f44 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:10.865777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8d5c81c5-0a08-492a-bfd7-58eb3d08cab7 None None] MFA Rules not processed for user `45cdaea591df442d8f6e5383794504b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:10.869773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8d5c81c5-0a08-492a-bfd7-58eb3d08cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:10.896723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 989/1981] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:10 2022] PUT /identity/v3/projects/725e038faada422c9ffab287dd601e90/users/e7739b2097524ff8a31720395de4edc5/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:10.922285 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4f107-7814-4b19-b271-164b168f3135 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:10.923351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4f107-7814-4b19-b271-164b168f3135 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:10.925051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4f107-7814-4b19-b271-164b168f3135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:11.047420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-36a4f107-7814-4b19-b271-164b168f3135 None None] MFA Rules not processed for user `e7739b2097524ff8a31720395de4edc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:11.051688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-36a4f107-7814-4b19-b271-164b168f3135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:11.134972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 993/1982] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:11.137738 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086c3c-7ec3-441e-90dd-89fce9dbf44c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:11.138075 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086c3c-7ec3-441e-90dd-89fce9dbf44c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:11.138368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086c3c-7ec3-441e-90dd-89fce9dbf44c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:11.149343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 994/1983] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 16:00:11 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:00:11.151043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae086c3c-7ec3-441e-90dd-89fce9dbf44c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:11.161920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ae086c3c-7ec3-441e-90dd-89fce9dbf44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:11.286452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 990/1984] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:11.292222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:11.292404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4f107-7814-4b19-b271-164b168f3135 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:11.350766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae086c3c-7ec3-441e-90dd-89fce9dbf44c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:11.364513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19631f37-4f54-4c76-a15b-d0de4d286a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:11.366889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19631f37-4f54-4c76-a15b-d0de4d286a85 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:11.370012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19631f37-4f54-4c76-a15b-d0de4d286a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:11.370688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19631f37-4f54-4c76-a15b-d0de4d286a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:11.378151 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-19631f37-4f54-4c76-a15b-d0de4d286a85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:11.514502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4f107-7814-4b19-b271-164b168f3135 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:11.533151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94189832-bcdb-4aed-b0c2-714c51878c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:11.534020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94189832-bcdb-4aed-b0c2-714c51878c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:11.534321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94189832-bcdb-4aed-b0c2-714c51878c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:11.534608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94189832-bcdb-4aed-b0c2-714c51878c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:11.535373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94189832-bcdb-4aed-b0c2-714c51878c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:11.537425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94189832-bcdb-4aed-b0c2-714c51878c9c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:11.547977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19631f37-4f54-4c76-a15b-d0de4d286a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:11.551135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19631f37-4f54-4c76-a15b-d0de4d286a85 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:11.598055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 995/1985] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:11.607891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ab3d1-0829-4e6c-a66a-27795ec5d3d9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:11.608433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ab3d1-0829-4e6c-a66a-27795ec5d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:11.614008 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 991/1986] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:11 2022] POST /identity/v3/projects => generated 385 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:11.614181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94189832-bcdb-4aed-b0c2-714c51878c9c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:11.619647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ab3d1-0829-4e6c-a66a-27795ec5d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:11.661685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:11.683503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7a1ab3d1-0829-4e6c-a66a-27795ec5d3d9 None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:11.685632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7a1ab3d1-0829-4e6c-a66a-27795ec5d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:11.791065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94189832-bcdb-4aed-b0c2-714c51878c9c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:11.802908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cdcb7-bbad-41c5-a5a8-bc748c9ca0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:11.803140 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cdcb7-bbad-41c5-a5a8-bc748c9ca0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:11.803462 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cdcb7-bbad-41c5-a5a8-bc748c9ca0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:11.803627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cdcb7-bbad-41c5-a5a8-bc748c9ca0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:11.804913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cdcb7-bbad-41c5-a5a8-bc748c9ca0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:11.807295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cdcb7-bbad-41c5-a5a8-bc748c9ca0c9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:11.851297 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 992/1987] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:11 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:11.851297 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cdcb7-bbad-41c5-a5a8-bc748c9ca0c9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:11.854450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7a8cdcb7-bbad-41c5-a5a8-bc748c9ca0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:11.932348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 996/1988] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 16:00:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:11.937476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ab3d1-0829-4e6c-a66a-27795ec5d3d9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:11.986233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ab3d1-0829-4e6c-a66a-27795ec5d3d9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:12.047367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cdcb7-bbad-41c5-a5a8-bc748c9ca0c9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:12.068852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:12.070355 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:12.070703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:12.071042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] PATH_INFO: `/v3/projects/f1ae78ac5a3e4c289c54ca9a627f3e29` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:12.089593 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ae78ac5a3e4c289c54ca9a627f3e29)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:12.094592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:12.154744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8a825-9dde-4f51-b78a-97c6154f9f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:12.156444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8a825-9dde-4f51-b78a-97c6154f9f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:12.157251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8a825-9dde-4f51-b78a-97c6154f9f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:12.157827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8a825-9dde-4f51-b78a-97c6154f9f5f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:12.159517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8a825-9dde-4f51-b78a-97c6154f9f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:12.164992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8a825-9dde-4f51-b78a-97c6154f9f5f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:12.221695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ae78ac5a3e4c289c54ca9a627f3e29', 'request_id': 'req-3ab4b076-8a7a-4e40-b137-b7b323d06160'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:12.233735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 997/1989] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:11 2022] POST /identity/v3/users => generated 299 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:12.238117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8a825-9dde-4f51-b78a-97c6154f9f5f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:12.258189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ae78ac5a3e4c289c54ca9a627f3e29', 'request_id': 'req-3ab4b076-8a7a-4e40-b137-b7b323d06160'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:12.297413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8a825-9dde-4f51-b78a-97c6154f9f5f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:12.300850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ae78ac5a3e4c289c54ca9a627f3e29', 'request_id': 'req-3ab4b076-8a7a-4e40-b137-b7b323d06160'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:12.340708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:12.347546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] The token cache is being invalidate because project f1ae78ac5a3e4c289c54ca9a627f3e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:12.348104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:12.349539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:12.358418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 993/1990] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:11 2022] DELETE /identity/v3/projects/f1ae78ac5a3e4c289c54ca9a627f3e29 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:12.360093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:12.363380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:12.485156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109972f1-153b-48a7-8973-96e7e34b219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:12.485880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109972f1-153b-48a7-8973-96e7e34b219e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:12.486197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109972f1-153b-48a7-8973-96e7e34b219e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:12.486782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109972f1-153b-48a7-8973-96e7e34b219e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:12.488211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109972f1-153b-48a7-8973-96e7e34b219e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:12.490409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109972f1-153b-48a7-8973-96e7e34b219e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:12.524003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:12.529741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 998/1991] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:12 2022] POST /identity/v3/users => generated 299 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:12.530972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109972f1-153b-48a7-8973-96e7e34b219e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:12.541509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-109972f1-153b-48a7-8973-96e7e34b219e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:12.573786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109972f1-153b-48a7-8973-96e7e34b219e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:12.584824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c536c4c-dbf1-4743-a875-1b0d0b082837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:12.585340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c536c4c-dbf1-4743-a875-1b0d0b082837 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:12.587607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c536c4c-dbf1-4743-a875-1b0d0b082837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:12.588315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c536c4c-dbf1-4743-a875-1b0d0b082837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:12.590307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c536c4c-dbf1-4743-a875-1b0d0b082837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:12.593867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c536c4c-dbf1-4743-a875-1b0d0b082837 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:12.623919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 999/1992] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:12.626048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c536c4c-dbf1-4743-a875-1b0d0b082837 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:12.629445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5c536c4c-dbf1-4743-a875-1b0d0b082837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:12.663197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c536c4c-dbf1-4743-a875-1b0d0b082837 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:12.673424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4b076-8a7a-4e40-b137-b7b323d06160 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:12.675635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:12.677600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:12.678335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:12.678933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] PATH_INFO: `/v3/users/eb3084f20b6d452ca600b00ba6f6933f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:12.682273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3084f20b6d452ca600b00ba6f6933f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:12.687626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:12.702042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6695d-9ecb-41a3-b783-4475680368f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:12.703268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6695d-9ecb-41a3-b783-4475680368f1 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:12.703782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6695d-9ecb-41a3-b783-4475680368f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:12.704289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6695d-9ecb-41a3-b783-4475680368f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:12.706633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b6e6695d-9ecb-41a3-b783-4475680368f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:12.726497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6695d-9ecb-41a3-b783-4475680368f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:12.728733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6695d-9ecb-41a3-b783-4475680368f1 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:12.744735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 994/1993] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:12.757007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6695d-9ecb-41a3-b783-4475680368f1 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:12.764789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b6e6695d-9ecb-41a3-b783-4475680368f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:12.829235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3084f20b6d452ca600b00ba6f6933f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:12.870235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3084f20b6d452ca600b00ba6f6933f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:12.876394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6695d-9ecb-41a3-b783-4475680368f1 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:12.892326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:12.893259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:12.893545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:12.893978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] PATH_INFO: `/v3/users/bb718b2467924fc3a22e34e23f195c52` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:12.899758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb718b2467924fc3a22e34e23f195c52)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:12.903612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:12.925427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3084f20b6d452ca600b00ba6f6933f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:12.936064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3084f20b6d452ca600b00ba6f6933f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:12.996547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3084f20b6d452ca600b00ba6f6933f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:13.031786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1000/1994] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:12 2022] DELETE /identity/v3/users/eb3084f20b6d452ca600b00ba6f6933f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:13.034103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:13.040112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:13.126185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb718b2467924fc3a22e34e23f195c52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:13.236175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb718b2467924fc3a22e34e23f195c52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:13.243486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb718b2467924fc3a22e34e23f195c52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:13.272020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb718b2467924fc3a22e34e23f195c52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:13.274111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb718b2467924fc3a22e34e23f195c52'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:13.319648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 995/1995] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:12 2022] DELETE /identity/v3/users/bb718b2467924fc3a22e34e23f195c52 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:13.322273 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:13.329073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:13.349339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:13.362439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dc6f0-44cf-4cd3-b15e-5553f6268f68 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:13.498624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3d5ad-1dfd-4905-a8a3-ebd86ca18500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:13.512443 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3d5ad-1dfd-4905-a8a3-ebd86ca18500 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:13.514825 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3d5ad-1dfd-4905-a8a3-ebd86ca18500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:13.515757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3d5ad-1dfd-4905-a8a3-ebd86ca18500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:13.520717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3d5ad-1dfd-4905-a8a3-ebd86ca18500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:13.529785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3d5ad-1dfd-4905-a8a3-ebd86ca18500 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:13.533295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1758a-10c8-4c54-9a69-fa9eeabcc306 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:13.540708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371581-1ba8-494d-8314-38395ea7e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:13.541743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371581-1ba8-494d-8314-38395ea7e103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:13.542097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371581-1ba8-494d-8314-38395ea7e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:13.542404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371581-1ba8-494d-8314-38395ea7e103 admin admin] PATH_INFO: `/v3/projects/f0cd261e2eb54e8db2bf1f6e632b230f/users/ed894e43d65e425f9a848eed45153829/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:13.574349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1001/1996] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:13.574349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fa70c-1538-45d6-81e0-04f6e3fc3868 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:13.574349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fa70c-1538-45d6-81e0-04f6e3fc3868 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:13.574349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fa70c-1538-45d6-81e0-04f6e3fc3868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:13.584055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371581-1ba8-494d-8314-38395ea7e103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cd261e2eb54e8db2bf1f6e632b230f, user_id=ed894e43d65e425f9a848eed45153829, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:13.590014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371581-1ba8-494d-8314-38395ea7e103 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:13.610700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5c2fa70c-1538-45d6-81e0-04f6e3fc3868 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:13.612117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5c2fa70c-1538-45d6-81e0-04f6e3fc3868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:13.615523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:13.624081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 996/1997] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:13 2022] PUT /identity/v3/projects/f0cd261e2eb54e8db2bf1f6e632b230f/users/ed894e43d65e425f9a848eed45153829/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:13.625308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371581-1ba8-494d-8314-38395ea7e103 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:13.630553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-70371581-1ba8-494d-8314-38395ea7e103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:13.839399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1002/1998] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:13.841008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fa70c-1538-45d6-81e0-04f6e3fc3868 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:13.858736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fa70c-1538-45d6-81e0-04f6e3fc3868 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:13.867465 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c774c-7dfb-4df0-aae8-c9b2049017f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:13.868746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c774c-7dfb-4df0-aae8-c9b2049017f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:13.869076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c774c-7dfb-4df0-aae8-c9b2049017f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:13.869572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c774c-7dfb-4df0-aae8-c9b2049017f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:13.870986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c774c-7dfb-4df0-aae8-c9b2049017f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:13.874118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c774c-7dfb-4df0-aae8-c9b2049017f6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:13.875054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371581-1ba8-494d-8314-38395ea7e103 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:13.885976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90834bd-b935-4ea6-989b-ac6f32515ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:13.889867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90834bd-b935-4ea6-989b-ac6f32515ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:13.890333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90834bd-b935-4ea6-989b-ac6f32515ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:13.890789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90834bd-b935-4ea6-989b-ac6f32515ac8 admin admin] PATH_INFO: `/v3/projects/2054c8f088714ad480f686bc5e89a207/users/a46434562cd34c32b6e8c8978efa6d35/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:13.902335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1003/1999] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:13.903894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c774c-7dfb-4df0-aae8-c9b2049017f6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:13.908555 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-577c774c-7dfb-4df0-aae8-c9b2049017f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:13.975145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90834bd-b935-4ea6-989b-ac6f32515ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2054c8f088714ad480f686bc5e89a207, user_id=a46434562cd34c32b6e8c8978efa6d35, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:13.982027 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90834bd-b935-4ea6-989b-ac6f32515ac8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:14.014871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 997/2000] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:13 2022] PUT /identity/v3/projects/2054c8f088714ad480f686bc5e89a207/users/a46434562cd34c32b6e8c8978efa6d35/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:14.017650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90834bd-b935-4ea6-989b-ac6f32515ac8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:14.079940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c774c-7dfb-4df0-aae8-c9b2049017f6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:14.178751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:14.195026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748f5bd-91b4-4974-9d14-5c731871bbee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:14.196395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748f5bd-91b4-4974-9d14-5c731871bbee service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:14.197182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748f5bd-91b4-4974-9d14-5c731871bbee service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:14.197782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748f5bd-91b4-4974-9d14-5c731871bbee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:14.273620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90834bd-b935-4ea6-989b-ac6f32515ac8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:14.303367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22aa15-e0ef-452a-8b7f-146844292ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:14.305028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22aa15-e0ef-452a-8b7f-146844292ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:14.305535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22aa15-e0ef-452a-8b7f-146844292ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:14.306049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22aa15-e0ef-452a-8b7f-146844292ff2 admin admin] PATH_INFO: `/v3/projects/f0cd261e2eb54e8db2bf1f6e632b230f/users/ed894e43d65e425f9a848eed45153829/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:14.321887 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22aa15-e0ef-452a-8b7f-146844292ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cd261e2eb54e8db2bf1f6e632b230f, user_id=ed894e43d65e425f9a848eed45153829, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:14.332754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22aa15-e0ef-452a-8b7f-146844292ff2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:14.373517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 998/2001] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:14 2022] PUT /identity/v3/projects/f0cd261e2eb54e8db2bf1f6e632b230f/users/ed894e43d65e425f9a848eed45153829/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:14.373517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22aa15-e0ef-452a-8b7f-146844292ff2 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:14.389682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748f5bd-91b4-4974-9d14-5c731871bbee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:14.393551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748f5bd-91b4-4974-9d14-5c731871bbee service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:14.421721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1004/2002] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:14.423538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748f5bd-91b4-4974-9d14-5c731871bbee service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:14.425171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5748f5bd-91b4-4974-9d14-5c731871bbee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:14.441184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748f5bd-91b4-4974-9d14-5c731871bbee service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:14.586910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22aa15-e0ef-452a-8b7f-146844292ff2 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:14.606464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508192c-e7c8-45f0-a3a5-e6c4c340be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:14.609054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508192c-e7c8-45f0-a3a5-e6c4c340be39 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:14.609054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508192c-e7c8-45f0-a3a5-e6c4c340be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:14.609054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508192c-e7c8-45f0-a3a5-e6c4c340be39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:14.609054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508192c-e7c8-45f0-a3a5-e6c4c340be39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:14.610343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508192c-e7c8-45f0-a3a5-e6c4c340be39 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:14.640857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 999/2003] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:14.642219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d07dab-26f3-40bd-a8f6-8bc2d6e3e7da None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:14.642546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d07dab-26f3-40bd-a8f6-8bc2d6e3e7da None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:14.642811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d07dab-26f3-40bd-a8f6-8bc2d6e3e7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:14.649933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:14.656630 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:14.657696 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:14.658470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] PATH_INFO: `/v3/projects/3f1a2aba571248f0b2cbb37f75b84d7b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:14.662783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1a2aba571248f0b2cbb37f75b84d7b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:14.669755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:14.691777 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:14.705864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a2d07dab-26f3-40bd-a8f6-8bc2d6e3e7da None None] MFA Rules not processed for user `ed894e43d65e425f9a848eed45153829`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:14.707272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a2d07dab-26f3-40bd-a8f6-8bc2d6e3e7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:14.819644 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1a2aba571248f0b2cbb37f75b84d7b', 'request_id': 'req-c17953c5-0414-44fe-b9c2-7c17c38e41ee'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:14.833463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1a2aba571248f0b2cbb37f75b84d7b', 'request_id': 'req-c17953c5-0414-44fe-b9c2-7c17c38e41ee'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:14.847943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1a2aba571248f0b2cbb37f75b84d7b', 'request_id': 'req-c17953c5-0414-44fe-b9c2-7c17c38e41ee'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:14.888149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1000/2004] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:14.890931 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d07dab-26f3-40bd-a8f6-8bc2d6e3e7da None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:14.908232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] The token cache is being invalidate because project 3f1a2aba571248f0b2cbb37f75b84d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:14.911535 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:14.914651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:14.917658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d07dab-26f3-40bd-a8f6-8bc2d6e3e7da None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:14.918672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1005/2005] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:14 2022] DELETE /identity/v3/projects/3f1a2aba571248f0b2cbb37f75b84d7b => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:14.922265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:14.931031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:15.042129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1e0b8-972d-44ab-8451-f1c3d962a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:15.043242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1e0b8-972d-44ab-8451-f1c3d962a224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:15.043641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1e0b8-972d-44ab-8451-f1c3d962a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:15.044029 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1e0b8-972d-44ab-8451-f1c3d962a224 admin admin] PATH_INFO: `/v3/projects/2054c8f088714ad480f686bc5e89a207/users/a46434562cd34c32b6e8c8978efa6d35/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:15.046939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1e0b8-972d-44ab-8451-f1c3d962a224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2054c8f088714ad480f686bc5e89a207, user_id=a46434562cd34c32b6e8c8978efa6d35, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:15.050331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1e0b8-972d-44ab-8451-f1c3d962a224 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:15.071203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:15.072967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1001/2006] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:14 2022] PUT /identity/v3/projects/2054c8f088714ad480f686bc5e89a207/users/a46434562cd34c32b6e8c8978efa6d35/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:15.078369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ba59d-fb94-4d1c-9928-b34c9f9000e9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:15.079685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ba59d-fb94-4d1c-9928-b34c9f9000e9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:15.080535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ba59d-fb94-4d1c-9928-b34c9f9000e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:15.199149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-200ba59d-fb94-4d1c-9928-b34c9f9000e9 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:15.201782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-200ba59d-fb94-4d1c-9928-b34c9f9000e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:15.224920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17953c5-0414-44fe-b9c2-7c17c38e41ee admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:15.353127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7d6ff-1a76-45a0-a76e-440f5eb4f7f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:15.354134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7d6ff-1a76-45a0-a76e-440f5eb4f7f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:15.354591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7d6ff-1a76-45a0-a76e-440f5eb4f7f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:15.355032 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7d6ff-1a76-45a0-a76e-440f5eb4f7f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:15.371086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-89c7d6ff-1a76-45a0-a76e-440f5eb4f7f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:15.543990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7d6ff-1a76-45a0-a76e-440f5eb4f7f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:15.545511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7d6ff-1a76-45a0-a76e-440f5eb4f7f1 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:15.566317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1006/2007] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:15.567879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36859225-e4ca-4099-833f-bf9ecd5cc18b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:15.568176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36859225-e4ca-4099-833f-bf9ecd5cc18b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:15.568465 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36859225-e4ca-4099-833f-bf9ecd5cc18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:15.615500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1002/2008] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 541 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:15.625075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b4217-7dda-410d-b047-1b4a5fe77fc9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:15.626319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b4217-7dda-410d-b047-1b4a5fe77fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:15.627062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b4217-7dda-410d-b047-1b4a5fe77fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:15.673863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-36859225-e4ca-4099-833f-bf9ecd5cc18b None None] MFA Rules not processed for user `a46434562cd34c32b6e8c8978efa6d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:15.676854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-36859225-e4ca-4099-833f-bf9ecd5cc18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:15.739480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2e2b4217-7dda-410d-b047-1b4a5fe77fc9 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:15.745162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2e2b4217-7dda-410d-b047-1b4a5fe77fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:15.769010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1003/2009] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:00:15.771119 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b4217-7dda-410d-b047-1b4a5fe77fc9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:15.779141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2e2b4217-7dda-410d-b047-1b4a5fe77fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:15.824306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b4217-7dda-410d-b047-1b4a5fe77fc9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:15.838576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:15.839580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:15.839874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:15.840223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] PATH_INFO: `/v3/users/45cdaea591df442d8f6e5383794504b7` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:15.842044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=45cdaea591df442d8f6e5383794504b7)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:15.844961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:15.860966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:15.952340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45cdaea591df442d8f6e5383794504b7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:15.972337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1007/2010] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:15.973253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36859225-e4ca-4099-833f-bf9ecd5cc18b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:15.981507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45cdaea591df442d8f6e5383794504b7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:15.982299 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45cdaea591df442d8f6e5383794504b7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:15.989156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36859225-e4ca-4099-833f-bf9ecd5cc18b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:15.992629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45cdaea591df442d8f6e5383794504b7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:15.993604 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45cdaea591df442d8f6e5383794504b7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:15.999212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956d778-53b5-48e8-8034-c0b26d56501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:16.000900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956d778-53b5-48e8-8034-c0b26d56501b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.001918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956d778-53b5-48e8-8034-c0b26d56501b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.002619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956d778-53b5-48e8-8034-c0b26d56501b admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.004197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956d778-53b5-48e8-8034-c0b26d56501b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:16.004780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956d778-53b5-48e8-8034-c0b26d56501b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:16.008950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956d778-53b5-48e8-8034-c0b26d56501b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:16.030144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1004/2011] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:15 2022] DELETE /identity/v3/users/45cdaea591df442d8f6e5383794504b7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:16.032514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:16.036064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1008/2012] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:16.037015 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.037470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956d778-53b5-48e8-8034-c0b26d56501b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:16.042065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1956d778-53b5-48e8-8034-c0b26d56501b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.063016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:16.076887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956d778-53b5-48e8-8034-c0b26d56501b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:16.167200 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598dfb-cfde-4d1c-9903-7d31a714d5da admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:16.173520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:16.174429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.174715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.174996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] PATH_INFO: `/v3/projects/fed1c17142614dbaa95a7076e5f35d3e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.176378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed1c17142614dbaa95a7076e5f35d3e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:16.178373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:16.196921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028904d5-5605-48b9-bfa3-89742f6fa580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:16.198325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028904d5-5605-48b9-bfa3-89742f6fa580 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.199758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028904d5-5605-48b9-bfa3-89742f6fa580 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.200500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028904d5-5605-48b9-bfa3-89742f6fa580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.205101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-028904d5-5605-48b9-bfa3-89742f6fa580 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.252520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed1c17142614dbaa95a7076e5f35d3e', 'request_id': 'req-7a471210-14a5-4b03-aff9-4fa665769fb5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.264575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed1c17142614dbaa95a7076e5f35d3e', 'request_id': 'req-7a471210-14a5-4b03-aff9-4fa665769fb5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.279579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed1c17142614dbaa95a7076e5f35d3e', 'request_id': 'req-7a471210-14a5-4b03-aff9-4fa665769fb5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.303685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] The token cache is being invalidate because project fed1c17142614dbaa95a7076e5f35d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:16.304752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.306085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7a471210-14a5-4b03-aff9-4fa665769fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.307284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028904d5-5605-48b9-bfa3-89742f6fa580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:16.312041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1005/2013] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:16 2022] DELETE /identity/v3/projects/fed1c17142614dbaa95a7076e5f35d3e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:16.312041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88df25-a0fc-41c7-b9b6-6381e21ddb11 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.312041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88df25-a0fc-41c7-b9b6-6381e21ddb11 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.312041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88df25-a0fc-41c7-b9b6-6381e21ddb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.312479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028904d5-5605-48b9-bfa3-89742f6fa580 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:16.330043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1009/2014] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:16.331447 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028904d5-5605-48b9-bfa3-89742f6fa580 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:16.332726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4e88df25-a0fc-41c7-b9b6-6381e21ddb11 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:16.333758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-028904d5-5605-48b9-bfa3-89742f6fa580 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.334338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4e88df25-a0fc-41c7-b9b6-6381e21ddb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.350432 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:16.357525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028904d5-5605-48b9-bfa3-89742f6fa580 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:16.418514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1006/2015] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:16.419751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88df25-a0fc-41c7-b9b6-6381e21ddb11 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:16.432151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4e88df25-a0fc-41c7-b9b6-6381e21ddb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.446019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88df25-a0fc-41c7-b9b6-6381e21ddb11 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:16.452346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:16.453258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.453547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.453828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] PATH_INFO: `/v3/users/faf4e44ebc044016b5c0df885d31afb1` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.455244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf4e44ebc044016b5c0df885d31afb1)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:16.456684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7ebe6-c15a-45cb-a4f6-e9b9a70b6973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:16.457238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:16.457531 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ebe6-c15a-45cb-a4f6-e9b9a70b6973 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.457921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ebe6-c15a-45cb-a4f6-e9b9a70b6973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.458438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ebe6-c15a-45cb-a4f6-e9b9a70b6973 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.459666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7ebe6-c15a-45cb-a4f6-e9b9a70b6973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:16.463072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7ebe6-c15a-45cb-a4f6-e9b9a70b6973 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:16.499607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1010/2016] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:16 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:16.500991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7ebe6-c15a-45cb-a4f6-e9b9a70b6973 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:16.503029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22f7ebe6-c15a-45cb-a4f6-e9b9a70b6973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.520818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf4e44ebc044016b5c0df885d31afb1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.537561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf4e44ebc044016b5c0df885d31afb1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.538340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf4e44ebc044016b5c0df885d31afb1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.549137 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf4e44ebc044016b5c0df885d31afb1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.549137 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf4e44ebc044016b5c0df885d31afb1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.570619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1007/2017] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:16 2022] DELETE /identity/v3/users/faf4e44ebc044016b5c0df885d31afb1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:16.574890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:16.576637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.592239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:16.626623 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7ebe6-c15a-45cb-a4f6-e9b9a70b6973 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:16.699053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb85c56-097f-4048-9544-f695963c2466 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:16.706659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036765c-202b-4946-87ab-2f5e50c5ecc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:16.707897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036765c-202b-4946-87ab-2f5e50c5ecc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.708886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036765c-202b-4946-87ab-2f5e50c5ecc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.709648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036765c-202b-4946-87ab-2f5e50c5ecc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.714523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4036765c-202b-4946-87ab-2f5e50c5ecc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.725472 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:16.728625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.729142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.730690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] PATH_INFO: `/v3/users/f8bdc9d1a0194505ae40d22498cc2f1e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.732634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8bdc9d1a0194505ae40d22498cc2f1e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:16.735410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:16.745702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036765c-202b-4946-87ab-2f5e50c5ecc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:16.749802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036765c-202b-4946-87ab-2f5e50c5ecc0 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:16.774887 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1008/2018] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:16.776152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036765c-202b-4946-87ab-2f5e50c5ecc0 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:16.777960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4036765c-202b-4946-87ab-2f5e50c5ecc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.796385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036765c-202b-4946-87ab-2f5e50c5ecc0 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:16.805400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7ea91-dcc9-4930-8f42-64901423bac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:16.806238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7ea91-dcc9-4930-8f42-64901423bac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.806691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7ea91-dcc9-4930-8f42-64901423bac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.807336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7ea91-dcc9-4930-8f42-64901423bac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.808568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7ea91-dcc9-4930-8f42-64901423bac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:16.810620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7ea91-dcc9-4930-8f42-64901423bac8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:16.823654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8bdc9d1a0194505ae40d22498cc2f1e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.843830 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1009/2019] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:16 2022] POST /identity/v3/users => generated 292 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:16.845842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028567a8-7cf7-4590-8d1e-f3f3a796edcf None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.846194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028567a8-7cf7-4590-8d1e-f3f3a796edcf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.846622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028567a8-7cf7-4590-8d1e-f3f3a796edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.863846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8bdc9d1a0194505ae40d22498cc2f1e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.881136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-028567a8-7cf7-4590-8d1e-f3f3a796edcf None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:16.884330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-028567a8-7cf7-4590-8d1e-f3f3a796edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.888109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8bdc9d1a0194505ae40d22498cc2f1e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.889548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8bdc9d1a0194505ae40d22498cc2f1e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.903841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1010/2020] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:16.904726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028567a8-7cf7-4590-8d1e-f3f3a796edcf None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:16.918697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-028567a8-7cf7-4590-8d1e-f3f3a796edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:16.933009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8bdc9d1a0194505ae40d22498cc2f1e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:16.934320 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028567a8-7cf7-4590-8d1e-f3f3a796edcf None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:16.948359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28e5f4-4ff2-45a8-826a-8a3c3834c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:16.949480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e5f4-4ff2-45a8-826a-8a3c3834c661 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:16.949688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e5f4-4ff2-45a8-826a-8a3c3834c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:16.950026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e5f4-4ff2-45a8-826a-8a3c3834c661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:16.950898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28e5f4-4ff2-45a8-826a-8a3c3834c661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:16.953640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28e5f4-4ff2-45a8-826a-8a3c3834c661 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:16.956733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:16.972264 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1011/2022] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:16.972573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1011/2022] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:16 2022] DELETE /identity/v3/users/f8bdc9d1a0194505ae40d22498cc2f1e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:16.974022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28e5f4-4ff2-45a8-826a-8a3c3834c661 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:16.982926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ba28e5f4-4ff2-45a8-826a-8a3c3834c661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:17.008649 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:17.018281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28e5f4-4ff2-45a8-826a-8a3c3834c661 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:17.249448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c4a0d-6a93-47f2-bc52-69f78b975e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:17.250941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c4a0d-6a93-47f2-bc52-69f78b975e4b service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:17.251869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c4a0d-6a93-47f2-bc52-69f78b975e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:17.253077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c4a0d-6a93-47f2-bc52-69f78b975e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:17.321817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c4e18-7d80-4eeb-8298-f75da13edabd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:17.329906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1f6f7-35b6-4f92-b75a-c52a1b8e0be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:17.331410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1f6f7-35b6-4f92-b75a-c52a1b8e0be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:17.332269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1f6f7-35b6-4f92-b75a-c52a1b8e0be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:17.332736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1f6f7-35b6-4f92-b75a-c52a1b8e0be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:17.334885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1f6f7-35b6-4f92-b75a-c52a1b8e0be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:17.337106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1f6f7-35b6-4f92-b75a-c52a1b8e0be0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:17.356628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1012/2023] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:17.363226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1f6f7-35b6-4f92-b75a-c52a1b8e0be0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:17.404132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:17.428687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1f6f7-35b6-4f92-b75a-c52a1b8e0be0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:17.457930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5a963-c2c7-4058-b59d-392a0be68e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:17.462748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5a963-c2c7-4058-b59d-392a0be68e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:17.468788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5a963-c2c7-4058-b59d-392a0be68e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:17.470255 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5a963-c2c7-4058-b59d-392a0be68e0e admin admin] PATH_INFO: `/v3/projects/d1bc72543df6462d92c882b2e4fc75a2/users/e7599e25af064ac29e912200029791d9/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:17.513527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c4a0d-6a93-47f2-bc52-69f78b975e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:17.515427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c4a0d-6a93-47f2-bc52-69f78b975e4b service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:17.545038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1012/2024] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:17.547572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5a963-c2c7-4058-b59d-392a0be68e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bc72543df6462d92c882b2e4fc75a2, user_id=e7599e25af064ac29e912200029791d9, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:17.552687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5a963-c2c7-4058-b59d-392a0be68e0e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:17.582450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1013/2025] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:17 2022] PUT /identity/v3/projects/d1bc72543df6462d92c882b2e4fc75a2/users/e7599e25af064ac29e912200029791d9/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:17.603965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce055-ddee-4868-a63e-e0b700b8c43b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:17.604381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce055-ddee-4868-a63e-e0b700b8c43b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:17.604729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce055-ddee-4868-a63e-e0b700b8c43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:17.658351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2c9ce055-ddee-4868-a63e-e0b700b8c43b None None] MFA Rules not processed for user `e7599e25af064ac29e912200029791d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:17.660002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2c9ce055-ddee-4868-a63e-e0b700b8c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:17.838606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1013/2026] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:00:17.845069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5a963-c2c7-4058-b59d-392a0be68e0e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:17.950091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5a963-c2c7-4058-b59d-392a0be68e0e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:17.956274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d79901-cc32-4840-be85-8a59e7e9ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:17.957010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d79901-cc32-4840-be85-8a59e7e9ba95 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:17.957304 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d79901-cc32-4840-be85-8a59e7e9ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:17.957752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d79901-cc32-4840-be85-8a59e7e9ba95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:17.958502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d79901-cc32-4840-be85-8a59e7e9ba95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:17.961933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d79901-cc32-4840-be85-8a59e7e9ba95 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:17.989764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ce055-ddee-4868-a63e-e0b700b8c43b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:17.992447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2c9ce055-ddee-4868-a63e-e0b700b8c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:18.043939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1014/2027] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:17 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:00:18.046033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d79901-cc32-4840-be85-8a59e7e9ba95 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:18.067822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ce055-ddee-4868-a63e-e0b700b8c43b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:18.191290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:18.282055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:18.289664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:18.289991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:18.290490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] PATH_INFO: `/v3/projects/d7db6cf0b43049e099b563cda67bb91a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:18.298471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7db6cf0b43049e099b563cda67bb91a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:18.312640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:18.330675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d79901-cc32-4840-be85-8a59e7e9ba95 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:18.343353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab04dd-1f84-4399-9856-a9bb64403a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:18.344415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab04dd-1f84-4399-9856-a9bb64403a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:18.345040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab04dd-1f84-4399-9856-a9bb64403a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:18.345746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab04dd-1f84-4399-9856-a9bb64403a11 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:18.348411 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab04dd-1f84-4399-9856-a9bb64403a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:18.356190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab04dd-1f84-4399-9856-a9bb64403a11 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:18.453203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1015/2028] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:18 2022] POST /identity/v3/users => generated 297 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:18.456474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab04dd-1f84-4399-9856-a9bb64403a11 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:18.489006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab04dd-1f84-4399-9856-a9bb64403a11 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:18.535313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7db6cf0b43049e099b563cda67bb91a', 'request_id': 'req-7eeacd75-a5b3-47fa-b308-2320c2e610b1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:18.563816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7db6cf0b43049e099b563cda67bb91a', 'request_id': 'req-7eeacd75-a5b3-47fa-b308-2320c2e610b1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:18.592891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7db6cf0b43049e099b563cda67bb91a', 'request_id': 'req-7eeacd75-a5b3-47fa-b308-2320c2e610b1'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:18.684141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] The token cache is being invalidate because project d7db6cf0b43049e099b563cda67bb91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:18.684693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:18.690533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:18.691515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:18.703294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1014/2029] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:17 2022] DELETE /identity/v3/projects/d7db6cf0b43049e099b563cda67bb91a => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:18.711577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:18.718543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:18.756587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e361a-2a78-447e-be6f-a97250656c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:18.762222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e361a-2a78-447e-be6f-a97250656c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:18.762941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e361a-2a78-447e-be6f-a97250656c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:18.763513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e361a-2a78-447e-be6f-a97250656c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:18.765415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e361a-2a78-447e-be6f-a97250656c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:18.774555 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e361a-2a78-447e-be6f-a97250656c51 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:18.835816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1016/2030] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:18.838418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e361a-2a78-447e-be6f-a97250656c51 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:18.846868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-713e361a-2a78-447e-be6f-a97250656c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:18.961097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e361a-2a78-447e-be6f-a97250656c51 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:18.988381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:18.994412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:18.995263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:18.996741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] PATH_INFO: `/v3/users/ed894e43d65e425f9a848eed45153829` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:19.007988 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed894e43d65e425f9a848eed45153829)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:19.014209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeacd75-a5b3-47fa-b308-2320c2e610b1 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:19.019803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:19.025281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:19.027569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:19.028219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:19.028786 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] PATH_INFO: `/v3/projects/8b8c2e96639f49cda735407320beceda` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:19.033170 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8c2e96639f49cda735407320beceda)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:19.039912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:19.235289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8c2e96639f49cda735407320beceda', 'request_id': 'req-94803ce3-4bd1-4301-8799-5fc7da6c6097'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.270310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8c2e96639f49cda735407320beceda', 'request_id': 'req-94803ce3-4bd1-4301-8799-5fc7da6c6097'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.279854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed894e43d65e425f9a848eed45153829'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.290918 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8c2e96639f49cda735407320beceda', 'request_id': 'req-94803ce3-4bd1-4301-8799-5fc7da6c6097'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.339714 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:19.346038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed894e43d65e425f9a848eed45153829'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.348909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] The token cache is being invalidate because project 8b8c2e96639f49cda735407320beceda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:19.350689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.353592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.364533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1015/2031] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:18 2022] DELETE /identity/v3/projects/8b8c2e96639f49cda735407320beceda => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:19.364533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:19.370708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:19.379024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed894e43d65e425f9a848eed45153829'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.381060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed894e43d65e425f9a848eed45153829'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.404350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed894e43d65e425f9a848eed45153829'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.452951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1017/2032] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:18 2022] DELETE /identity/v3/users/ed894e43d65e425f9a848eed45153829 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:19.454970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:19.473838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:19.652981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94803ce3-4bd1-4301-8799-5fc7da6c6097 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:19.658695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549e33f-bfc2-4564-815a-e14072484881 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:19.668669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:19.670104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:19.670577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:19.671063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] PATH_INFO: `/v3/projects/ef7d79d451b640d6bd410686668d6131` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:19.675846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ba4ef-d9ea-42b8-ae97-58f7ccb0fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:19.677813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ba4ef-d9ea-42b8-ae97-58f7ccb0fbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:19.678313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ba4ef-d9ea-42b8-ae97-58f7ccb0fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:19.678757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ba4ef-d9ea-42b8-ae97-58f7ccb0fbb3 admin admin] PATH_INFO: `/v3/projects/6881268efe214029a824b9f9345885a9/users/737d3c1c78cc45dfa53a1ffd553a429c/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:19.685328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7d79d451b640d6bd410686668d6131)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:19.689278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:19.758157 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ba4ef-d9ea-42b8-ae97-58f7ccb0fbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6881268efe214029a824b9f9345885a9, user_id=737d3c1c78cc45dfa53a1ffd553a429c, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:19.763205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ba4ef-d9ea-42b8-ae97-58f7ccb0fbb3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:19.818074 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1016/2033] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:19 2022] PUT /identity/v3/projects/6881268efe214029a824b9f9345885a9/users/737d3c1c78cc45dfa53a1ffd553a429c/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:19.821974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6423f6-a748-4bc5-9e5f-7997a3e7215c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:19.822553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6423f6-a748-4bc5-9e5f-7997a3e7215c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:19.823046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6423f6-a748-4bc5-9e5f-7997a3e7215c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:19.902904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7d79d451b640d6bd410686668d6131', 'request_id': 'req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.917103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5e6423f6-a748-4bc5-9e5f-7997a3e7215c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:19.925658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5e6423f6-a748-4bc5-9e5f-7997a3e7215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:19.942880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7d79d451b640d6bd410686668d6131', 'request_id': 'req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.985939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7d79d451b640d6bd410686668d6131', 'request_id': 'req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:19.992008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:20.030358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] The token cache is being invalidate because project ef7d79d451b640d6bd410686668d6131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:20.030358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.031397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.036585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1018/2034] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:19 2022] DELETE /identity/v3/projects/ef7d79d451b640d6bd410686668d6131 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:20.037632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:20.041834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:20.158588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1017/2035] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:20.166962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6423f6-a748-4bc5-9e5f-7997a3e7215c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:20.169683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5e6423f6-a748-4bc5-9e5f-7997a3e7215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:20.196558 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6423f6-a748-4bc5-9e5f-7997a3e7215c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:20.203794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:20.205574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:20.205945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:20.206603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] PATH_INFO: `/v3/users/f6e7d7c90d5c4af091693d7f7a640b1c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:20.208714 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e7d7c90d5c4af091693d7f7a640b1c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:20.211050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ad9c-515c-4fe6-aec2-e109c3901ae4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:20.211330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:20.223679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f6995-2640-4059-a0a9-2427b5532cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:20.224795 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f6995-2640-4059-a0a9-2427b5532cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:20.225300 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f6995-2640-4059-a0a9-2427b5532cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:20.225832 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f6995-2640-4059-a0a9-2427b5532cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:20.228780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f6995-2640-4059-a0a9-2427b5532cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:20.232540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f6995-2640-4059-a0a9-2427b5532cb3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:20.257251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1019/2036] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:20.260533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b51c60-064f-43ae-8c73-4e933aeaaa5e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:20.261069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b51c60-064f-43ae-8c73-4e933aeaaa5e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:20.261629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b51c60-064f-43ae-8c73-4e933aeaaa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:20.296884 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e7d7c90d5c4af091693d7f7a640b1c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.305212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e0b51c60-064f-43ae-8c73-4e933aeaaa5e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:20.307976 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e0b51c60-064f-43ae-8c73-4e933aeaaa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:20.316665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e7d7c90d5c4af091693d7f7a640b1c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.317788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e7d7c90d5c4af091693d7f7a640b1c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.331135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e7d7c90d5c4af091693d7f7a640b1c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.332268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e7d7c90d5c4af091693d7f7a640b1c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.334491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1020/2037] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:20.336837 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b51c60-064f-43ae-8c73-4e933aeaaa5e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:20.341428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:20.353057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b51c60-064f-43ae-8c73-4e933aeaaa5e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:20.362975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472191c-11cc-435b-a78d-50160e853010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:20.363944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472191c-11cc-435b-a78d-50160e853010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:20.364236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472191c-11cc-435b-a78d-50160e853010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:20.364707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472191c-11cc-435b-a78d-50160e853010 admin admin] PATH_INFO: `/v3/projects/6881268efe214029a824b9f9345885a9/users/737d3c1c78cc45dfa53a1ffd553a429c/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:20.367715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472191c-11cc-435b-a78d-50160e853010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6881268efe214029a824b9f9345885a9, user_id=737d3c1c78cc45dfa53a1ffd553a429c, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:20.371259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472191c-11cc-435b-a78d-50160e853010 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:20.387493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1018/2038] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:20 2022] DELETE /identity/v3/users/f6e7d7c90d5c4af091693d7f7a640b1c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:20.390001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:20.392864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:20.407361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1021/2039] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:20 2022] PUT /identity/v3/projects/6881268efe214029a824b9f9345885a9/users/737d3c1c78cc45dfa53a1ffd553a429c/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:20.407361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472191c-11cc-435b-a78d-50160e853010 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:20.422695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6472191c-11cc-435b-a78d-50160e853010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:20.527930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f804a4-78a6-45d0-b294-553b5624a3d7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:20.534841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacac5cd-be4c-4b4d-92f6-724c5cb8a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:20.535996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac5cd-be4c-4b4d-92f6-724c5cb8a7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:20.537151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac5cd-be4c-4b4d-92f6-724c5cb8a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:20.538471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac5cd-be4c-4b4d-92f6-724c5cb8a7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:20.539845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacac5cd-be4c-4b4d-92f6-724c5cb8a7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:20.540223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacac5cd-be4c-4b4d-92f6-724c5cb8a7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:20.542108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacac5cd-be4c-4b4d-92f6-724c5cb8a7ad admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:20.546186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472191c-11cc-435b-a78d-50160e853010 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:20.554687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:20.556830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:20.556830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:20.557249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] PATH_INFO: `/v3/projects/f0cd261e2eb54e8db2bf1f6e632b230f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:20.559932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0cd261e2eb54e8db2bf1f6e632b230f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:20.563444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:20.569002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1019/2040] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:20.571472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972961d8-dfdc-44d6-8faf-e97668008f5a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:20.571673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972961d8-dfdc-44d6-8faf-e97668008f5a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:20.571972 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972961d8-dfdc-44d6-8faf-e97668008f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:20.671460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-972961d8-dfdc-44d6-8faf-e97668008f5a None None] MFA Rules not processed for user `737d3c1c78cc45dfa53a1ffd553a429c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:20.673693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-972961d8-dfdc-44d6-8faf-e97668008f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:20.807351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0cd261e2eb54e8db2bf1f6e632b230f', 'request_id': 'req-783e046f-8908-44c2-a08f-f5a8c3107ba7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.825499 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0cd261e2eb54e8db2bf1f6e632b230f', 'request_id': 'req-783e046f-8908-44c2-a08f-f5a8c3107ba7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.842275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0cd261e2eb54e8db2bf1f6e632b230f', 'request_id': 'req-783e046f-8908-44c2-a08f-f5a8c3107ba7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.876777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:20.900470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1020/2041] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:20.901578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972961d8-dfdc-44d6-8faf-e97668008f5a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:20.916108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] The token cache is being invalidate because project f0cd261e2eb54e8db2bf1f6e632b230f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:20.920445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.922897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:20.932070 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1022/2042] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:20 2022] DELETE /identity/v3/projects/f0cd261e2eb54e8db2bf1f6e632b230f => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:20.932366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972961d8-dfdc-44d6-8faf-e97668008f5a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:20.939788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:20.941622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:21.078738 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e046f-8908-44c2-a08f-f5a8c3107ba7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:21.089189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf266f5-ef02-46e2-87fb-a0745d6d55e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:21.090534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf266f5-ef02-46e2-87fb-a0745d6d55e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:21.091919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf266f5-ef02-46e2-87fb-a0745d6d55e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:21.092461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf266f5-ef02-46e2-87fb-a0745d6d55e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:21.096456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5cf266f5-ef02-46e2-87fb-a0745d6d55e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:21.143829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc1fb4-919e-4c70-afd6-f99539363160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:21.144640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc1fb4-919e-4c70-afd6-f99539363160 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:21.145013 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc1fb4-919e-4c70-afd6-f99539363160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:21.145376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc1fb4-919e-4c70-afd6-f99539363160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:21.146181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc1fb4-919e-4c70-afd6-f99539363160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:21.149791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc1fb4-919e-4c70-afd6-f99539363160 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:21.206774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:21.229797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1021/2043] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:20 2022] POST /identity/v3/projects => generated 379 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:21.230907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed842909-f2d5-4a1f-a041-86366760bd04 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:21.231579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed842909-f2d5-4a1f-a041-86366760bd04 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:21.233412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed842909-f2d5-4a1f-a041-86366760bd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:21.284124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ed842909-f2d5-4a1f-a041-86366760bd04 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:21.287456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ed842909-f2d5-4a1f-a041-86366760bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:21.332236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf266f5-ef02-46e2-87fb-a0745d6d55e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:21.336807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf266f5-ef02-46e2-87fb-a0745d6d55e9 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:21.379926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1023/2044] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:21.384954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf266f5-ef02-46e2-87fb-a0745d6d55e9 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:21.389549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5cf266f5-ef02-46e2-87fb-a0745d6d55e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:21.459458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf266f5-ef02-46e2-87fb-a0745d6d55e9 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:21.711718 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1022/2045] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:21.715258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed842909-f2d5-4a1f-a041-86366760bd04 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:21.722153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ed842909-f2d5-4a1f-a041-86366760bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:21.797951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed842909-f2d5-4a1f-a041-86366760bd04 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:21.823496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1304696-230f-42fd-98c9-b81a4dba3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:21.826430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1304696-230f-42fd-98c9-b81a4dba3895 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:21.826969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1304696-230f-42fd-98c9-b81a4dba3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:21.831564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1304696-230f-42fd-98c9-b81a4dba3895 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:21.833661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1304696-230f-42fd-98c9-b81a4dba3895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:21.840748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1304696-230f-42fd-98c9-b81a4dba3895 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:21.949705 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:21.953475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:21.954087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:21.954475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] PATH_INFO: `/v3/projects/ec7e0c2222cf46a08852464cf0726f6e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:21.963779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7e0c2222cf46a08852464cf0726f6e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:21.978841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1023/2046] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:21 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:21.979043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:21.989317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1027002-54a4-4c86-9492-5b4af49d8887 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:21.989825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1027002-54a4-4c86-9492-5b4af49d8887 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:21.990321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1027002-54a4-4c86-9492-5b4af49d8887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:22.070489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f1027002-54a4-4c86-9492-5b4af49d8887 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:22.072144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f1027002-54a4-4c86-9492-5b4af49d8887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:22.091318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1024/2047] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:22.091318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1027002-54a4-4c86-9492-5b4af49d8887 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:22.152017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7e0c2222cf46a08852464cf0726f6e', 'request_id': 'req-e2c9a87f-27cd-45cc-8e9c-341525909925'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:22.156214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:22.169896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7e0c2222cf46a08852464cf0726f6e', 'request_id': 'req-e2c9a87f-27cd-45cc-8e9c-341525909925'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:22.181071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7e0c2222cf46a08852464cf0726f6e', 'request_id': 'req-e2c9a87f-27cd-45cc-8e9c-341525909925'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:22.192439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1027002-54a4-4c86-9492-5b4af49d8887 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:22.204691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] The token cache is being invalidate because project ec7e0c2222cf46a08852464cf0726f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:22.205442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:22.206794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:22.209759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1024/2048] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:21 2022] DELETE /identity/v3/projects/ec7e0c2222cf46a08852464cf0726f6e => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:22.214548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:22.216234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:22.266866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fdb75-5f7e-4e42-bfd9-09bfcd30ea6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:22.268021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fdb75-5f7e-4e42-bfd9-09bfcd30ea6c service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:22.268534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fdb75-5f7e-4e42-bfd9-09bfcd30ea6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:22.268978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fdb75-5f7e-4e42-bfd9-09bfcd30ea6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:22.272136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c38fdb75-5f7e-4e42-bfd9-09bfcd30ea6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:22.305678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9a87f-27cd-45cc-8e9c-341525909925 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:22.310808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798acf3-e8e7-4f0b-9bba-2c0660cb0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:22.311549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798acf3-e8e7-4f0b-9bba-2c0660cb0ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:22.311838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798acf3-e8e7-4f0b-9bba-2c0660cb0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:22.312120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798acf3-e8e7-4f0b-9bba-2c0660cb0ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:22.312882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798acf3-e8e7-4f0b-9bba-2c0660cb0ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:22.314577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798acf3-e8e7-4f0b-9bba-2c0660cb0ab2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:22.333856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1025/2049] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:22.333856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798acf3-e8e7-4f0b-9bba-2c0660cb0ab2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:22.336054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c798acf3-e8e7-4f0b-9bba-2c0660cb0ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:22.342644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:22.356840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798acf3-e8e7-4f0b-9bba-2c0660cb0ab2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:22.362441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fdb75-5f7e-4e42-bfd9-09bfcd30ea6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:22.363675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f000d0-d7c0-43c6-9c50-0ab51edfb3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:22.363994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fdb75-5f7e-4e42-bfd9-09bfcd30ea6c service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:22.364358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f000d0-d7c0-43c6-9c50-0ab51edfb3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:22.364652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f000d0-d7c0-43c6-9c50-0ab51edfb3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:22.365791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f000d0-d7c0-43c6-9c50-0ab51edfb3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:22.367041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f000d0-d7c0-43c6-9c50-0ab51edfb3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:22.367403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f000d0-d7c0-43c6-9c50-0ab51edfb3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:22.369270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f000d0-d7c0-43c6-9c50-0ab51edfb3ae admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:22.377581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1025/2050] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:22.379352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fdb75-5f7e-4e42-bfd9-09bfcd30ea6c service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:22.382294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c38fdb75-5f7e-4e42-bfd9-09bfcd30ea6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:22.389889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1026/2051] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:22.389889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f000d0-d7c0-43c6-9c50-0ab51edfb3ae admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:22.406005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fdb75-5f7e-4e42-bfd9-09bfcd30ea6c service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:22.406558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f000d0-d7c0-43c6-9c50-0ab51edfb3ae admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:22.416374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f079b7-49f6-47d2-80c1-b1756c8106b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:22.417154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f079b7-49f6-47d2-80c1-b1756c8106b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:22.417451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:22.417648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f079b7-49f6-47d2-80c1-b1756c8106b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:22.417781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f079b7-49f6-47d2-80c1-b1756c8106b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:22.420325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f079b7-49f6-47d2-80c1-b1756c8106b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:22.420563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:22.420563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:22.420563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] PATH_INFO: `/v3/users/9649e24e615f487caaab46395bd41882` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:22.420952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f079b7-49f6-47d2-80c1-b1756c8106b8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:22.421639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9649e24e615f487caaab46395bd41882)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:22.424864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:22.440748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1027/2052] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:22.441888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f079b7-49f6-47d2-80c1-b1756c8106b8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:22.454516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f079b7-49f6-47d2-80c1-b1756c8106b8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:22.462887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b0b89-d020-4d32-82f9-013a13a8e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:22.463742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b0b89-d020-4d32-82f9-013a13a8e017 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:22.463908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b0b89-d020-4d32-82f9-013a13a8e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:22.464184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b0b89-d020-4d32-82f9-013a13a8e017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:22.464903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b0b89-d020-4d32-82f9-013a13a8e017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:22.466899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b0b89-d020-4d32-82f9-013a13a8e017 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:22.516968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1028/2053] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:22 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:22.516968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b0b89-d020-4d32-82f9-013a13a8e017 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:22.527637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9649e24e615f487caaab46395bd41882'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:22.550517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9649e24e615f487caaab46395bd41882'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:22.551767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9649e24e615f487caaab46395bd41882'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:22.566691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9649e24e615f487caaab46395bd41882'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:22.567828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9649e24e615f487caaab46395bd41882'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:22.601495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1026/2054] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:22 2022] DELETE /identity/v3/users/9649e24e615f487caaab46395bd41882 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:22.601495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:22.601495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:22.661332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b0b89-d020-4d32-82f9-013a13a8e017 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:22.774300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe0641-0cca-46ed-ab4f-41dc809656e0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:22.784929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:22.787152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010cc24-cba8-4408-84a2-3aad25d6209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:22.788565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010cc24-cba8-4408-84a2-3aad25d6209c admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:22.789412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010cc24-cba8-4408-84a2-3aad25d6209c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:22.790022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010cc24-cba8-4408-84a2-3aad25d6209c admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:22.790864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010cc24-cba8-4408-84a2-3aad25d6209c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:22.794822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010cc24-cba8-4408-84a2-3aad25d6209c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:22.868195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1027/2055] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:22 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:22.876035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010cc24-cba8-4408-84a2-3aad25d6209c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:22.892599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010cc24-cba8-4408-84a2-3aad25d6209c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:22.902565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b72e7a-7d93-4f37-84d6-e90ac34db65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:22.903990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b72e7a-7d93-4f37-84d6-e90ac34db65c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:22.904436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b72e7a-7d93-4f37-84d6-e90ac34db65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:22.904819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b72e7a-7d93-4f37-84d6-e90ac34db65c admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:22.905761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b72e7a-7d93-4f37-84d6-e90ac34db65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:22.908664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b72e7a-7d93-4f37-84d6-e90ac34db65c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:22.952700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1028/2056] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:22.959397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b72e7a-7d93-4f37-84d6-e90ac34db65c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:22.967796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346af52-14b7-429a-bd9d-934cdf90c531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:22.974813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346af52-14b7-429a-bd9d-934cdf90c531 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:22.975310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346af52-14b7-429a-bd9d-934cdf90c531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:22.977663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346af52-14b7-429a-bd9d-934cdf90c531 admin admin] PATH_INFO: `/v3/projects/e14023b089e64950a499df92a7d0eeed/users/89e779d96a0a419e9c57570b981a8ab3/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:23.002368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b72e7a-7d93-4f37-84d6-e90ac34db65c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:23.033003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828afa0e-f3f4-408a-88a6-18128f15ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:23.036209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828afa0e-f3f4-408a-88a6-18128f15ba13 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:23.036760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828afa0e-f3f4-408a-88a6-18128f15ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:23.039565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828afa0e-f3f4-408a-88a6-18128f15ba13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:23.040830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346af52-14b7-429a-bd9d-934cdf90c531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14023b089e64950a499df92a7d0eeed, user_id=89e779d96a0a419e9c57570b981a8ab3, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:23.043919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346af52-14b7-429a-bd9d-934cdf90c531 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:23.046584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828afa0e-f3f4-408a-88a6-18128f15ba13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:23.050766 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828afa0e-f3f4-408a-88a6-18128f15ba13 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:23.067701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1029/2057] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:23.068818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828afa0e-f3f4-408a-88a6-18128f15ba13 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:23.087583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-828afa0e-f3f4-408a-88a6-18128f15ba13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:23.091543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1029/2058] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:22 2022] PUT /identity/v3/projects/e14023b089e64950a499df92a7d0eeed/users/89e779d96a0a419e9c57570b981a8ab3/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:23.109948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346af52-14b7-429a-bd9d-934cdf90c531 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:23.129278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828afa0e-f3f4-408a-88a6-18128f15ba13 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:23.208265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:23.260862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346af52-14b7-429a-bd9d-934cdf90c531 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:23.274367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8767a54-d8d6-4518-9c79-920b216afe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:23.277065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767a54-d8d6-4518-9c79-920b216afe93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:23.277889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767a54-d8d6-4518-9c79-920b216afe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:23.280354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767a54-d8d6-4518-9c79-920b216afe93 admin admin] PATH_INFO: `/v3/projects/176af844e237427abf9b735e97142547/users/94e1790824b646e79298903e090dcadb/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:23.312742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:23.314466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:23.314978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:23.315475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] PATH_INFO: `/v3/users/e7599e25af064ac29e912200029791d9` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:23.317850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7599e25af064ac29e912200029791d9)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:23.321298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:23.324149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8767a54-d8d6-4518-9c79-920b216afe93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176af844e237427abf9b735e97142547, user_id=94e1790824b646e79298903e090dcadb, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:23.334230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8767a54-d8d6-4518-9c79-920b216afe93 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:23.384116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1030/2059] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:23 2022] PUT /identity/v3/projects/176af844e237427abf9b735e97142547/users/94e1790824b646e79298903e090dcadb/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:23.411600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa8b4-3287-4435-b479-5c9e56e29f05 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:23.411600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa8b4-3287-4435-b479-5c9e56e29f05 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:23.411600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa8b4-3287-4435-b479-5c9e56e29f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:23.470447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7599e25af064ac29e912200029791d9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:23.513058 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-096aa8b4-3287-4435-b479-5c9e56e29f05 None None] MFA Rules not processed for user `89e779d96a0a419e9c57570b981a8ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:23.514653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-096aa8b4-3287-4435-b479-5c9e56e29f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:23.538320 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7599e25af064ac29e912200029791d9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:23.540247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7599e25af064ac29e912200029791d9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:23.566100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7599e25af064ac29e912200029791d9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:23.567436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7599e25af064ac29e912200029791d9'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:23.597941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1030/2060] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:23 2022] DELETE /identity/v3/users/e7599e25af064ac29e912200029791d9 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:23.598731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:23.602978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:23.671705 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1031/2061] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:23.681117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f646a-6259-4f9d-8aaf-a072726fff8b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:23.681680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f646a-6259-4f9d-8aaf-a072726fff8b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:23.682119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f646a-6259-4f9d-8aaf-a072726fff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:23.719748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64278828-5111-4432-a60e-e4b2d1ff766f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:23.729099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea686d-dac7-4377-9200-779a75fe7ee7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:23.734768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ee8f646a-6259-4f9d-8aaf-a072726fff8b None None] MFA Rules not processed for user `94e1790824b646e79298903e090dcadb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:23.736346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea686d-dac7-4377-9200-779a75fe7ee7 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:23.736956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ee8f646a-6259-4f9d-8aaf-a072726fff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:23.737350 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea686d-dac7-4377-9200-779a75fe7ee7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:23.744092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea686d-dac7-4377-9200-779a75fe7ee7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:23.749278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c9ea686d-dac7-4377-9200-779a75fe7ee7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:23.816563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:23.904799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1032/2062] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:23.910400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:23.910636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59676c-4547-45b0-bafe-49a8463a4fe3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:23.910879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59676c-4547-45b0-bafe-49a8463a4fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:23.911194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59676c-4547-45b0-bafe-49a8463a4fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:23.923287 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea686d-dac7-4377-9200-779a75fe7ee7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:23.926222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea686d-dac7-4377-9200-779a75fe7ee7 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:23.931827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7a59676c-4547-45b0-bafe-49a8463a4fe3 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:23.933212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7a59676c-4547-45b0-bafe-49a8463a4fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:23.951937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1031/2063] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:23.954361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea686d-dac7-4377-9200-779a75fe7ee7 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:23.956850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c9ea686d-dac7-4377-9200-779a75fe7ee7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:24.044972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1033/2064] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:24.046067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59676c-4547-45b0-bafe-49a8463a4fe3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:24.047476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7a59676c-4547-45b0-bafe-49a8463a4fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:24.060968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59676c-4547-45b0-bafe-49a8463a4fe3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:24.066169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7349b2e-0b82-4da0-8e0a-cac4c385b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:24.066767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7349b2e-0b82-4da0-8e0a-cac4c385b72c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.067060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7349b2e-0b82-4da0-8e0a-cac4c385b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.067381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7349b2e-0b82-4da0-8e0a-cac4c385b72c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.068105 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7349b2e-0b82-4da0-8e0a-cac4c385b72c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:24.071347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7349b2e-0b82-4da0-8e0a-cac4c385b72c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:24.076996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea686d-dac7-4377-9200-779a75fe7ee7 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:24.085496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c899b-2d53-450b-bce7-0f9dfcc03812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:24.086283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c899b-2d53-450b-bce7-0f9dfcc03812 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.086653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c899b-2d53-450b-bce7-0f9dfcc03812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.087011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c899b-2d53-450b-bce7-0f9dfcc03812 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.089025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c899b-2d53-450b-bce7-0f9dfcc03812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:24.092101 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c899b-2d53-450b-bce7-0f9dfcc03812 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:24.111339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1034/2065] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:24 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:24.112650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7349b2e-0b82-4da0-8e0a-cac4c385b72c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:24.114534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c7349b2e-0b82-4da0-8e0a-cac4c385b72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:24.145798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1032/2066] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:23 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:24.147205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c899b-2d53-450b-bce7-0f9dfcc03812 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:24.241132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c899b-2d53-450b-bce7-0f9dfcc03812 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:24.243868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7349b2e-0b82-4da0-8e0a-cac4c385b72c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:24.249531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7f93-5b20-41a0-9da8-d37638b90b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:24.250774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7f93-5b20-41a0-9da8-d37638b90b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.251359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7f93-5b20-41a0-9da8-d37638b90b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.251880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7f93-5b20-41a0-9da8-d37638b90b2e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.254145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e7f93-5b20-41a0-9da8-d37638b90b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:24.258706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e7f93-5b20-41a0-9da8-d37638b90b2e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:24.290667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1033/2067] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:24 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:24.292335 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7f93-5b20-41a0-9da8-d37638b90b2e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:24.308520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7f93-5b20-41a0-9da8-d37638b90b2e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:24.316816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708f124-cff6-46ee-9768-b266f208d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:24.317935 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708f124-cff6-46ee-9768-b266f208d74e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.318516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708f124-cff6-46ee-9768-b266f208d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.319067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708f124-cff6-46ee-9768-b266f208d74e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.321062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708f124-cff6-46ee-9768-b266f208d74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:24.325341 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708f124-cff6-46ee-9768-b266f208d74e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:24.345886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b95a7b-919e-46f9-a1e0-f921851e75f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:24.346992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b95a7b-919e-46f9-a1e0-f921851e75f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.347631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b95a7b-919e-46f9-a1e0-f921851e75f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.347943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b95a7b-919e-46f9-a1e0-f921851e75f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.361394 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1034/2068] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:24 2022] POST /identity/v3/users => generated 296 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:24.361651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b95a7b-919e-46f9-a1e0-f921851e75f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:24.363591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708f124-cff6-46ee-9768-b266f208d74e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:24.367558 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f708f124-cff6-46ee-9768-b266f208d74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:24.369468 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b95a7b-919e-46f9-a1e0-f921851e75f5 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:24.376539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:24.393004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1035/2069] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:24.402011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708f124-cff6-46ee-9768-b266f208d74e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:24.409059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:24.410170 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.410596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.411029 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] PATH_INFO: `/v3/projects/e668250481b140c19da9fe8c3f55d7cf` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.414595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e668250481b140c19da9fe8c3f55d7cf)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:24.417831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b95a7b-919e-46f9-a1e0-f921851e75f5 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:24.419732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:24.476336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b95a7b-919e-46f9-a1e0-f921851e75f5 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:24.501140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d735edc-c208-41a5-96ae-441ffb14ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:24.502316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d735edc-c208-41a5-96ae-441ffb14ed56 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.502829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d735edc-c208-41a5-96ae-441ffb14ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.503361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d735edc-c208-41a5-96ae-441ffb14ed56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.504751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d735edc-c208-41a5-96ae-441ffb14ed56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:24.507945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d735edc-c208-41a5-96ae-441ffb14ed56 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:24.548369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:DELETE=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:24.557845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1036/2070] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:24.557845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d735edc-c208-41a5-96ae-441ffb14ed56 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:24.569630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e668250481b140c19da9fe8c3f55d7cf', 'request_id': 'req-4a845649-314d-4443-a3f9-e2e8fac00d31'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:24.590094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e668250481b140c19da9fe8c3f55d7cf', 'request_id': 'req-4a845649-314d-4443-a3f9-e2e8fac00d31'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:24.602039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d735edc-c208-41a5-96ae-441ffb14ed56 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:24.603951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e668250481b140c19da9fe8c3f55d7cf', 'request_id': 'req-4a845649-314d-4443-a3f9-e2e8fac00d31'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:24.648981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] The token cache is being invalidate because project e668250481b140c19da9fe8c3f55d7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:24.651246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:24.655707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:24.661946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1035/2071] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:24 2022] DELETE /identity/v3/projects/e668250481b140c19da9fe8c3f55d7cf => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:24.671709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:24.672375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:24.765370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf92b2-c571-4cc1-a6b4-6a42d2b6b9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:24.766778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf92b2-c571-4cc1-a6b4-6a42d2b6b9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.767276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf92b2-c571-4cc1-a6b4-6a42d2b6b9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.767794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf92b2-c571-4cc1-a6b4-6a42d2b6b9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.768702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf92b2-c571-4cc1-a6b4-6a42d2b6b9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:24.771236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf92b2-c571-4cc1-a6b4-6a42d2b6b9fe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:24.788183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1037/2072] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:24.790366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88452a31-b357-48b9-be87-84bdc90dc9d1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.790583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88452a31-b357-48b9-be87-84bdc90dc9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.790930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88452a31-b357-48b9-be87-84bdc90dc9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.816854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-88452a31-b357-48b9-be87-84bdc90dc9d1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:24.818862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-88452a31-b357-48b9-be87-84bdc90dc9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:24.840732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1038/2073] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:24.840732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88452a31-b357-48b9-be87-84bdc90dc9d1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:24.843884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-88452a31-b357-48b9-be87-84bdc90dc9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:24.863895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88452a31-b357-48b9-be87-84bdc90dc9d1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:24.864390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a845649-314d-4443-a3f9-e2e8fac00d31 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:24.874006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca49da-ab5e-4219-8391-5e0e25275d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:24.875754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09a219-ae4c-4996-9598-5cfebd931589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:24.878810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca49da-ab5e-4219-8391-5e0e25275d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.879285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca49da-ab5e-4219-8391-5e0e25275d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.879538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09a219-ae4c-4996-9598-5cfebd931589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.879835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09a219-ae4c-4996-9598-5cfebd931589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.880115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09a219-ae4c-4996-9598-5cfebd931589 admin admin] PATH_INFO: `/v3/projects/6861245a2a224653aefc8cfb5e9b03ce/users/ffde5affd2154266a63dc36ea3087c43/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.880313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca49da-ab5e-4219-8391-5e0e25275d19 admin admin] PATH_INFO: `/v3/projects/ebcb12e3d9294f3b94882c9d1e6cde86/users/32e11de5c55f4facb6f67b06bfa6e3f6/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.905547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09a219-ae4c-4996-9598-5cfebd931589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6861245a2a224653aefc8cfb5e9b03ce, user_id=ffde5affd2154266a63dc36ea3087c43, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:24.910269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca49da-ab5e-4219-8391-5e0e25275d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcb12e3d9294f3b94882c9d1e6cde86, user_id=32e11de5c55f4facb6f67b06bfa6e3f6, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:24.912738 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca49da-ab5e-4219-8391-5e0e25275d19 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:24.922362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09a219-ae4c-4996-9598-5cfebd931589 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:24.957641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1039/2074] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:24 2022] PUT /identity/v3/projects/ebcb12e3d9294f3b94882c9d1e6cde86/users/32e11de5c55f4facb6f67b06bfa6e3f6/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:24.958991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4869ed-7769-49c5-8702-cf78b48aba41 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:24.959390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4869ed-7769-49c5-8702-cf78b48aba41 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:24.959663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4869ed-7769-49c5-8702-cf78b48aba41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:24.973286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1036/2075] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:24 2022] PUT /identity/v3/projects/6861245a2a224653aefc8cfb5e9b03ce/users/ffde5affd2154266a63dc36ea3087c43/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:24.975093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09a219-ae4c-4996-9598-5cfebd931589 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:24.989532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5e4869ed-7769-49c5-8702-cf78b48aba41 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:24.990872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5e4869ed-7769-49c5-8702-cf78b48aba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:25.119930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09a219-ae4c-4996-9598-5cfebd931589 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:25.144666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256064c-7ec5-40da-bfa1-629173656b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:25.145926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256064c-7ec5-40da-bfa1-629173656b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:25.146501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256064c-7ec5-40da-bfa1-629173656b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:25.147065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256064c-7ec5-40da-bfa1-629173656b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:25.150869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256064c-7ec5-40da-bfa1-629173656b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:25.158419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256064c-7ec5-40da-bfa1-629173656b90 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:25.160564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1040/2076] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:25.170881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4869ed-7769-49c5-8702-cf78b48aba41 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:25.206853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1037/2077] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:25.211720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256064c-7ec5-40da-bfa1-629173656b90 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:25.228361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4869ed-7769-49c5-8702-cf78b48aba41 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:25.246652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256064c-7ec5-40da-bfa1-629173656b90 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:25.255626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3321b-8f7b-4fea-a1d4-32e536597999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:25.256760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3321b-8f7b-4fea-a1d4-32e536597999 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:25.257884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3321b-8f7b-4fea-a1d4-32e536597999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:25.258353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3321b-8f7b-4fea-a1d4-32e536597999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:25.259777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3321b-8f7b-4fea-a1d4-32e536597999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:25.262946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3321b-8f7b-4fea-a1d4-32e536597999 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:25.263231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72ba6e-2ffb-43df-bb9e-f7932b68611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:25.264011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ba6e-2ffb-43df-bb9e-f7932b68611f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:25.264305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ba6e-2ffb-43df-bb9e-f7932b68611f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:25.264724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ba6e-2ffb-43df-bb9e-f7932b68611f admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:25.265564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72ba6e-2ffb-43df-bb9e-f7932b68611f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:25.265794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72ba6e-2ffb-43df-bb9e-f7932b68611f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:25.268595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72ba6e-2ffb-43df-bb9e-f7932b68611f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:25.287089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1038/2078] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:25.287943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72ba6e-2ffb-43df-bb9e-f7932b68611f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:25.308208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72ba6e-2ffb-43df-bb9e-f7932b68611f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:25.318322 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801934ac-dec8-45c3-85ac-1c82365c8263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:25.319443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801934ac-dec8-45c3-85ac-1c82365c8263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:25.319738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801934ac-dec8-45c3-85ac-1c82365c8263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:25.320520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801934ac-dec8-45c3-85ac-1c82365c8263 admin admin] PATH_INFO: `/v3/projects/ebcb12e3d9294f3b94882c9d1e6cde86/users/32e11de5c55f4facb6f67b06bfa6e3f6/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:25.321202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1041/2079] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:25.322898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3321b-8f7b-4fea-a1d4-32e536597999 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:25.323263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801934ac-dec8-45c3-85ac-1c82365c8263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcb12e3d9294f3b94882c9d1e6cde86, user_id=32e11de5c55f4facb6f67b06bfa6e3f6, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:25.326675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801934ac-dec8-45c3-85ac-1c82365c8263 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:25.329366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-78a3321b-8f7b-4fea-a1d4-32e536597999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:25.350257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1039/2080] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:25 2022] PUT /identity/v3/projects/ebcb12e3d9294f3b94882c9d1e6cde86/users/32e11de5c55f4facb6f67b06bfa6e3f6/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:25.350257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801934ac-dec8-45c3-85ac-1c82365c8263 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:25.359041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3321b-8f7b-4fea-a1d4-32e536597999 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:25.416170 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:25.457629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:25.472709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801934ac-dec8-45c3-85ac-1c82365c8263 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:25.479804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f7bbf-dadc-41c0-8307-4b3b5e1098b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:25.480735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f7bbf-dadc-41c0-8307-4b3b5e1098b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:25.481100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f7bbf-dadc-41c0-8307-4b3b5e1098b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:25.481485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f7bbf-dadc-41c0-8307-4b3b5e1098b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:25.482680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f7bbf-dadc-41c0-8307-4b3b5e1098b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:25.485620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f7bbf-dadc-41c0-8307-4b3b5e1098b1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:25.491492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:25.493016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:25.493603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:25.494156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] PATH_INFO: `/v3/projects/d1bc72543df6462d92c882b2e4fc75a2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:25.496641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1bc72543df6462d92c882b2e4fc75a2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:25.500638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:25.527052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1040/2081] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:25 2022] POST /identity/v3/projects => generated 407 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:25.527052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f7bbf-dadc-41c0-8307-4b3b5e1098b1 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:25.590021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1bc72543df6462d92c882b2e4fc75a2', 'request_id': 'req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:25.604343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1bc72543df6462d92c882b2e4fc75a2', 'request_id': 'req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:25.617495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1bc72543df6462d92c882b2e4fc75a2', 'request_id': 'req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:25.644959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] The token cache is being invalidate because project d1bc72543df6462d92c882b2e4fc75a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:25.645506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:25.646726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7ddff6d9-9e98-4afb-8274-9e66cd1827a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:25.648024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f7bbf-dadc-41c0-8307-4b3b5e1098b1 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:25.650939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1042/2082] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:25 2022] DELETE /identity/v3/projects/d1bc72543df6462d92c882b2e4fc75a2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:25.653427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e02aac-e16d-4649-ac4d-46f4b024758c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:25.653964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e02aac-e16d-4649-ac4d-46f4b024758c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:25.654466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e02aac-e16d-4649-ac4d-46f4b024758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:25.703268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e7e02aac-e16d-4649-ac4d-46f4b024758c None None] MFA Rules not processed for user `32e11de5c55f4facb6f67b06bfa6e3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:25.705898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e7e02aac-e16d-4649-ac4d-46f4b024758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:25.814706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7167b48-c815-4d62-90a4-cca6213b0d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:25.817647 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167b48-c815-4d62-90a4-cca6213b0d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:25.818314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167b48-c815-4d62-90a4-cca6213b0d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:25.819022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167b48-c815-4d62-90a4-cca6213b0d71 admin admin] PATH_INFO: `/v3/projects/6861245a2a224653aefc8cfb5e9b03ce/users/ffde5affd2154266a63dc36ea3087c43/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:25.824659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7167b48-c815-4d62-90a4-cca6213b0d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6861245a2a224653aefc8cfb5e9b03ce, user_id=ffde5affd2154266a63dc36ea3087c43, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:25.830894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7167b48-c815-4d62-90a4-cca6213b0d71 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:25.862573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1041/2083] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:25 2022] PUT /identity/v3/projects/6861245a2a224653aefc8cfb5e9b03ce/users/ffde5affd2154266a63dc36ea3087c43/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:25.868390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1043/2084] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:25.868602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7167b48-c815-4d62-90a4-cca6213b0d71 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:25.868700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e02aac-e16d-4649-ac4d-46f4b024758c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:25.871384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e7e02aac-e16d-4649-ac4d-46f4b024758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:25.873585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f7167b48-c815-4d62-90a4-cca6213b0d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:25.901085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e02aac-e16d-4649-ac4d-46f4b024758c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:26.055539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:26.079005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7167b48-c815-4d62-90a4-cca6213b0d71 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:26.088921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:26.089280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918494d-f1d4-4145-84c8-fe73d10af8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:26.089977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918494d-f1d4-4145-84c8-fe73d10af8af admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:26.090256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918494d-f1d4-4145-84c8-fe73d10af8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:26.090544 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918494d-f1d4-4145-84c8-fe73d10af8af admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:26.091296 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918494d-f1d4-4145-84c8-fe73d10af8af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:26.092636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:26.093377 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918494d-f1d4-4145-84c8-fe73d10af8af admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:26.093592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:26.094482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] PATH_INFO: `/v3/users/737d3c1c78cc45dfa53a1ffd553a429c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:26.097128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=737d3c1c78cc45dfa53a1ffd553a429c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:26.104607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:26.110760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:26.129713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1042/2085] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:25 2022] POST /identity/v3/users => generated 304 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:26.131215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45246eaa-df2a-4c82-a04b-ef92f9a25b89 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:26.131515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45246eaa-df2a-4c82-a04b-ef92f9a25b89 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:26.131852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45246eaa-df2a-4c82-a04b-ef92f9a25b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:26.174652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-45246eaa-df2a-4c82-a04b-ef92f9a25b89 None None] MFA Rules not processed for user `ffde5affd2154266a63dc36ea3087c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:26.179633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-45246eaa-df2a-4c82-a04b-ef92f9a25b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:26.227277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737d3c1c78cc45dfa53a1ffd553a429c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:26.264104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737d3c1c78cc45dfa53a1ffd553a429c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:26.278273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737d3c1c78cc45dfa53a1ffd553a429c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:26.279369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737d3c1c78cc45dfa53a1ffd553a429c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:26.299691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737d3c1c78cc45dfa53a1ffd553a429c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:26.299691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1044/2086] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:25 2022] DELETE /identity/v3/users/737d3c1c78cc45dfa53a1ffd553a429c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:26.299691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:26.301387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:26.342130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1043/2087] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:26.343928 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45246eaa-df2a-4c82-a04b-ef92f9a25b89 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:26.346304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-45246eaa-df2a-4c82-a04b-ef92f9a25b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:26.385043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45246eaa-df2a-4c82-a04b-ef92f9a25b89 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:26.432429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d4d6c-882f-47b1-a49e-1e7c284c48cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:26.455381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d4edb-aab0-44dd-9dc6-00fad97feac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:26.459628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d4edb-aab0-44dd-9dc6-00fad97feac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:26.461510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d4edb-aab0-44dd-9dc6-00fad97feac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:26.464089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d4edb-aab0-44dd-9dc6-00fad97feac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:26.472331 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-122d4edb-aab0-44dd-9dc6-00fad97feac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:26.534124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8516-50ee-42bc-bcea-6b6fd03ac869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:26.536021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8516-50ee-42bc-bcea-6b6fd03ac869 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:26.536398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8516-50ee-42bc-bcea-6b6fd03ac869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:26.536676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8516-50ee-42bc-bcea-6b6fd03ac869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:26.537669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c8516-50ee-42bc-bcea-6b6fd03ac869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:26.548544 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c8516-50ee-42bc-bcea-6b6fd03ac869 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:26.572059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1044/2088] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:26.573842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8516-50ee-42bc-bcea-6b6fd03ac869 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:26.596163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8516-50ee-42bc-bcea-6b6fd03ac869 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:26.613942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d4edb-aab0-44dd-9dc6-00fad97feac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:26.618616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d4edb-aab0-44dd-9dc6-00fad97feac5 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:26.621171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e5508-049c-49d3-8075-7d384ab4943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:26.623505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5508-049c-49d3-8075-7d384ab4943a admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:26.623901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5508-049c-49d3-8075-7d384ab4943a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:26.624201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5508-049c-49d3-8075-7d384ab4943a admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:26.628230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e5508-049c-49d3-8075-7d384ab4943a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:26.635042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e5508-049c-49d3-8075-7d384ab4943a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:26.642784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1045/2089] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:26.664235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1045/2090] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:00:26.668781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d4edb-aab0-44dd-9dc6-00fad97feac5 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:26.696445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d4edb-aab0-44dd-9dc6-00fad97feac5 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:26.708321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522265ff-97a7-4b4d-a45e-72065d659601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:26.712147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522265ff-97a7-4b4d-a45e-72065d659601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:26.713031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522265ff-97a7-4b4d-a45e-72065d659601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:26.713800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522265ff-97a7-4b4d-a45e-72065d659601 admin admin] PATH_INFO: `/v3/projects/a8a197f025bd4131aeb30b9b82fa4349/users/da0ee1f201794874876624bf8b6c7401/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:26.759559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522265ff-97a7-4b4d-a45e-72065d659601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a197f025bd4131aeb30b9b82fa4349, user_id=da0ee1f201794874876624bf8b6c7401, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:26.765743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522265ff-97a7-4b4d-a45e-72065d659601 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:26.812927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1046/2091] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:26 2022] PUT /identity/v3/projects/a8a197f025bd4131aeb30b9b82fa4349/users/da0ee1f201794874876624bf8b6c7401/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:26.841428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad5e0-19a6-4995-883c-86f4aabd4390 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:26.842602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad5e0-19a6-4995-883c-86f4aabd4390 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:26.843447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad5e0-19a6-4995-883c-86f4aabd4390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:26.968561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522265ff-97a7-4b4d-a45e-72065d659601 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:26.974988 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-522265ff-97a7-4b4d-a45e-72065d659601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:26.980085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fc5ad5e0-19a6-4995-883c-86f4aabd4390 None None] MFA Rules not processed for user `da0ee1f201794874876624bf8b6c7401`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:26.982305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fc5ad5e0-19a6-4995-883c-86f4aabd4390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:27.074881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:27.202003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:27.238734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522265ff-97a7-4b4d-a45e-72065d659601 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:27.247565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b702fec-5ac5-4756-bfe1-15ef7b850362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:27.248743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1046/2092] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:27.248862 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702fec-5ac5-4756-bfe1-15ef7b850362 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:27.249276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702fec-5ac5-4756-bfe1-15ef7b850362 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:27.249773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702fec-5ac5-4756-bfe1-15ef7b850362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:27.250752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ad5e0-19a6-4995-883c-86f4aabd4390 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:27.252488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fc5ad5e0-19a6-4995-883c-86f4aabd4390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:27.364660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b702fec-5ac5-4756-bfe1-15ef7b850362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:27.366934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b702fec-5ac5-4756-bfe1-15ef7b850362 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:27.405560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1047/2093] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:27.405560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b702fec-5ac5-4756-bfe1-15ef7b850362 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:27.417767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ad5e0-19a6-4995-883c-86f4aabd4390 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:27.424782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:27.425684 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:27.426027 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:27.426485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] PATH_INFO: `/v3/projects/6881268efe214029a824b9f9345885a9` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:27.428135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6881268efe214029a824b9f9345885a9)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:27.431974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:27.450255 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b702fec-5ac5-4756-bfe1-15ef7b850362 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:27.465413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f5fd7-0fbd-496d-840d-77e6668619b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:27.466573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f5fd7-0fbd-496d-840d-77e6668619b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:27.467039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f5fd7-0fbd-496d-840d-77e6668619b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:27.467561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f5fd7-0fbd-496d-840d-77e6668619b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:27.469154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f5fd7-0fbd-496d-840d-77e6668619b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:27.473263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f5fd7-0fbd-496d-840d-77e6668619b2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:27.530203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1048/2094] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:27 2022] POST /identity/v3/projects => generated 409 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:27.534393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f5fd7-0fbd-496d-840d-77e6668619b2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:27.563787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6881268efe214029a824b9f9345885a9', 'request_id': 'req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:27.577449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6881268efe214029a824b9f9345885a9', 'request_id': 'req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:27.591229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6881268efe214029a824b9f9345885a9', 'request_id': 'req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:27.609638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] The token cache is being invalidate because project 6881268efe214029a824b9f9345885a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:27.609980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:27.610749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-686d1c3c-22f9-4a66-b2a2-bae1fcf42a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:27.618200 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1047/2095] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:27 2022] DELETE /identity/v3/projects/6881268efe214029a824b9f9345885a9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:27.619830 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c8d0-67e9-4722-b434-97a8f6c9a55b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:27.620129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c8d0-67e9-4722-b434-97a8f6c9a55b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:27.620451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0c8d0-67e9-4722-b434-97a8f6c9a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:27.646253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-70d0c8d0-67e9-4722-b434-97a8f6c9a55b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:27.648225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-70d0c8d0-67e9-4722-b434-97a8f6c9a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:27.682277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f5fd7-0fbd-496d-840d-77e6668619b2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:27.690800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4721368-c3cc-4f81-9607-132eb46dbf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:27.692254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4721368-c3cc-4f81-9607-132eb46dbf1a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:27.692432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4721368-c3cc-4f81-9607-132eb46dbf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:27.692888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4721368-c3cc-4f81-9607-132eb46dbf1a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:27.694161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4721368-c3cc-4f81-9607-132eb46dbf1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:27.697576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4721368-c3cc-4f81-9607-132eb46dbf1a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:27.737504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1049/2096] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:27 2022] POST /identity/v3/users => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:00:27.739514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4721368-c3cc-4f81-9607-132eb46dbf1a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:27.743769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a4721368-c3cc-4f81-9607-132eb46dbf1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:27.792547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1048/2097] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:27.794661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0c8d0-67e9-4722-b434-97a8f6c9a55b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:27.800869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-70d0c8d0-67e9-4722-b434-97a8f6c9a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:27.810874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:27.822903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0c8d0-67e9-4722-b434-97a8f6c9a55b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:27.828277 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f8559-f9fc-4746-9d9d-c92462182bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:27.828975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8559-f9fc-4746-9d9d-c92462182bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:27.829270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8559-f9fc-4746-9d9d-c92462182bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:27.829550 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8559-f9fc-4746-9d9d-c92462182bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:27.830304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f8559-f9fc-4746-9d9d-c92462182bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:27.832047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f8559-f9fc-4746-9d9d-c92462182bbb admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:27.850125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1049/2098] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:27.850125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecec66-b53c-492f-8ba8-92e18f61aac0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:27.850125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecec66-b53c-492f-8ba8-92e18f61aac0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:27.850125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecec66-b53c-492f-8ba8-92e18f61aac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:27.855921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:27.871586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4721368-c3cc-4f81-9607-132eb46dbf1a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:27.872736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-75ecec66-b53c-492f-8ba8-92e18f61aac0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:27.874116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-75ecec66-b53c-492f-8ba8-92e18f61aac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:27.886113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f8812-0f05-4900-bba7-2b82b2dc5aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:27.887073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8812-0f05-4900-bba7-2b82b2dc5aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:27.887778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8812-0f05-4900-bba7-2b82b2dc5aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:27.888356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8812-0f05-4900-bba7-2b82b2dc5aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:27.893490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1050/2099] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:27.894572 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecec66-b53c-492f-8ba8-92e18f61aac0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:27.896127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ed1f8812-0f05-4900-bba7-2b82b2dc5aa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:27.908460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecec66-b53c-492f-8ba8-92e18f61aac0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:27.917732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47254ddd-c672-4c0c-9514-b2325b668250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:27.917732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47254ddd-c672-4c0c-9514-b2325b668250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:27.917732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47254ddd-c672-4c0c-9514-b2325b668250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:27.917732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47254ddd-c672-4c0c-9514-b2325b668250 admin admin] PATH_INFO: `/v3/projects/4070b5c2390940358c5ad611364d60dc/users/8815992d2a0f41db855d9ebff8cdf08f/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:27.967862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47254ddd-c672-4c0c-9514-b2325b668250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4070b5c2390940358c5ad611364d60dc, user_id=8815992d2a0f41db855d9ebff8cdf08f, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:27.970799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47254ddd-c672-4c0c-9514-b2325b668250 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.005541 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1051/2100] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:27 2022] PUT /identity/v3/projects/4070b5c2390940358c5ad611364d60dc/users/8815992d2a0f41db855d9ebff8cdf08f/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:28.009376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47254ddd-c672-4c0c-9514-b2325b668250 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:28.046520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f8812-0f05-4900-bba7-2b82b2dc5aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:28.051137 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f8812-0f05-4900-bba7-2b82b2dc5aa2 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.068186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1050/2101] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:28.069192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f8812-0f05-4900-bba7-2b82b2dc5aa2 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:28.083639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f8812-0f05-4900-bba7-2b82b2dc5aa2 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:28.162075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47254ddd-c672-4c0c-9514-b2325b668250 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:28.177050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2ee6a-0d48-4fdd-adfb-9d6408900658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:28.178259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2ee6a-0d48-4fdd-adfb-9d6408900658 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.179667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2ee6a-0d48-4fdd-adfb-9d6408900658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.180031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2ee6a-0d48-4fdd-adfb-9d6408900658 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.181774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2ee6a-0d48-4fdd-adfb-9d6408900658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:28.182487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2ee6a-0d48-4fdd-adfb-9d6408900658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:28.185742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2ee6a-0d48-4fdd-adfb-9d6408900658 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.210554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29981600-e13e-4aac-994e-04e5b41f59c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:28.212790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1052/2102] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:28.217487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29981600-e13e-4aac-994e-04e5b41f59c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.217955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29981600-e13e-4aac-994e-04e5b41f59c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.218223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29981600-e13e-4aac-994e-04e5b41f59c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.219270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29981600-e13e-4aac-994e-04e5b41f59c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:28.219489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2ee6a-0d48-4fdd-adfb-9d6408900658 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:28.221179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29981600-e13e-4aac-994e-04e5b41f59c8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.247377 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2ee6a-0d48-4fdd-adfb-9d6408900658 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:28.252897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1051/2103] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:28.254370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f18a7c-c261-44f7-aff1-96b7b0d379fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:28.255068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18a7c-c261-44f7-aff1-96b7b0d379fb admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.255385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18a7c-c261-44f7-aff1-96b7b0d379fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.255672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18a7c-c261-44f7-aff1-96b7b0d379fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.256629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f18a7c-c261-44f7-aff1-96b7b0d379fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:28.259948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f18a7c-c261-44f7-aff1-96b7b0d379fb admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.260458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29981600-e13e-4aac-994e-04e5b41f59c8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:28.283149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29981600-e13e-4aac-994e-04e5b41f59c8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:28.291427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bef20-1d7f-4ef4-8ca8-e2d2237ec157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:28.292950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bef20-1d7f-4ef4-8ca8-e2d2237ec157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.293451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bef20-1d7f-4ef4-8ca8-e2d2237ec157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.293920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bef20-1d7f-4ef4-8ca8-e2d2237ec157 admin admin] PATH_INFO: `/v3/projects/4070b5c2390940358c5ad611364d60dc/users/8815992d2a0f41db855d9ebff8cdf08f/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.297569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bef20-1d7f-4ef4-8ca8-e2d2237ec157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4070b5c2390940358c5ad611364d60dc, user_id=8815992d2a0f41db855d9ebff8cdf08f, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:28.302758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bef20-1d7f-4ef4-8ca8-e2d2237ec157 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.326110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1053/2104] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:28 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:28.328417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f18a7c-c261-44f7-aff1-96b7b0d379fb admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:28.330196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1052/2105] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:28 2022] PUT /identity/v3/projects/4070b5c2390940358c5ad611364d60dc/users/8815992d2a0f41db855d9ebff8cdf08f/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:28.344915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5886f40-1c3d-4f53-a414-6640f7d33fa2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.346945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5886f40-1c3d-4f53-a414-6640f7d33fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.346945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5886f40-1c3d-4f53-a414-6640f7d33fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.394166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f5886f40-1c3d-4f53-a414-6640f7d33fa2 None None] MFA Rules not processed for user `8815992d2a0f41db855d9ebff8cdf08f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:28.395749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f5886f40-1c3d-4f53-a414-6640f7d33fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:28.511089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f18a7c-c261-44f7-aff1-96b7b0d379fb admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:28.513762 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:28.521345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8719cd-90e2-4d5c-ad5d-9d4fe8fe01bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:28.523026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8719cd-90e2-4d5c-ad5d-9d4fe8fe01bb admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.523942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8719cd-90e2-4d5c-ad5d-9d4fe8fe01bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.524737 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8719cd-90e2-4d5c-ad5d-9d4fe8fe01bb admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.526014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8719cd-90e2-4d5c-ad5d-9d4fe8fe01bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:28.530592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8719cd-90e2-4d5c-ad5d-9d4fe8fe01bb admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.551781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1053/2106] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:00:28.573857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1054/2107] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:28 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:28.578328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5886f40-1c3d-4f53-a414-6640f7d33fa2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:28.601846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5886f40-1c3d-4f53-a414-6640f7d33fa2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:28.612022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8885101-a8bf-4690-9bcd-586a7e5a0f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:28.613417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885101-a8bf-4690-9bcd-586a7e5a0f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.614026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885101-a8bf-4690-9bcd-586a7e5a0f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.614564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885101-a8bf-4690-9bcd-586a7e5a0f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.615310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8719cd-90e2-4d5c-ad5d-9d4fe8fe01bb admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:28.616360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8885101-a8bf-4690-9bcd-586a7e5a0f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:28.617484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cc8719cd-90e2-4d5c-ad5d-9d4fe8fe01bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:28.622198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8885101-a8bf-4690-9bcd-586a7e5a0f88 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.666073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1054/2108] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:00:28.668263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8885101-a8bf-4690-9bcd-586a7e5a0f88 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:28.679421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:28.690730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8885101-a8bf-4690-9bcd-586a7e5a0f88 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:28.713009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d4326-dc93-4f68-8607-7e6e84455ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:28.714414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d4326-dc93-4f68-8607-7e6e84455ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.714907 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d4326-dc93-4f68-8607-7e6e84455ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.715801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d4326-dc93-4f68-8607-7e6e84455ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.717786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d4326-dc93-4f68-8607-7e6e84455ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:28.721113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d4326-dc93-4f68-8607-7e6e84455ab2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.729870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8719cd-90e2-4d5c-ad5d-9d4fe8fe01bb admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:28.739991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f011-e423-4199-b8f1-c928989e3561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:28.741491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f011-e423-4199-b8f1-c928989e3561 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.742705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f011-e423-4199-b8f1-c928989e3561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.743019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f011-e423-4199-b8f1-c928989e3561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.750227 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1055/2109] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:28.755632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d4326-dc93-4f68-8607-7e6e84455ab2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:28.767034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8f011-e423-4199-b8f1-c928989e3561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:28.769992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8f011-e423-4199-b8f1-c928989e3561 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.779976 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d4326-dc93-4f68-8607-7e6e84455ab2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:28.786634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1055/2110] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:00:28.788885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db3379-cd3c-4e67-8e30-e330b05588a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:28.790214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db3379-cd3c-4e67-8e30-e330b05588a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.790508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db3379-cd3c-4e67-8e30-e330b05588a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.790794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db3379-cd3c-4e67-8e30-e330b05588a2 admin admin] PATH_INFO: `/v3/projects/3abdbaf081a84754be1d6c4fe9b66be4/users/252aee53df604f5997b958ce157c4776/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.816223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db3379-cd3c-4e67-8e30-e330b05588a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abdbaf081a84754be1d6c4fe9b66be4, user_id=252aee53df604f5997b958ce157c4776, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:28.821118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db3379-cd3c-4e67-8e30-e330b05588a2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:28.847204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1056/2111] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:28 2022] PUT /identity/v3/projects/3abdbaf081a84754be1d6c4fe9b66be4/users/252aee53df604f5997b958ce157c4776/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:28.865487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2203120-254e-49ae-9646-b94a161a9ee2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:28.865917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2203120-254e-49ae-9646-b94a161a9ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:28.867877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2203120-254e-49ae-9646-b94a161a9ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:28.960458 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e2203120-254e-49ae-9646-b94a161a9ee2 None None] MFA Rules not processed for user `252aee53df604f5997b958ce157c4776`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:28.963284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e2203120-254e-49ae-9646-b94a161a9ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:29.129800 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1056/2112] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:29.130668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db3379-cd3c-4e67-8e30-e330b05588a2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:29.153127 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2203120-254e-49ae-9646-b94a161a9ee2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:29.297495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2203120-254e-49ae-9646-b94a161a9ee2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:29.303429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db3379-cd3c-4e67-8e30-e330b05588a2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:29.305607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979848-f78c-4015-82de-967021ef2edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:29.306713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979848-f78c-4015-82de-967021ef2edd service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:29.307271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979848-f78c-4015-82de-967021ef2edd service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:29.307813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979848-f78c-4015-82de-967021ef2edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:29.311096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c2979848-f78c-4015-82de-967021ef2edd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:29.313320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829dede-5eea-4f40-84c4-838c32b596dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:29.314812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829dede-5eea-4f40-84c4-838c32b596dc admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:29.315490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829dede-5eea-4f40-84c4-838c32b596dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:29.315990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829dede-5eea-4f40-84c4-838c32b596dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:29.317596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829dede-5eea-4f40-84c4-838c32b596dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:29.322754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829dede-5eea-4f40-84c4-838c32b596dc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:29.379243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1057/2113] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:29 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:29.386068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829dede-5eea-4f40-84c4-838c32b596dc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:29.440062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2979848-f78c-4015-82de-967021ef2edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:29.441565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2979848-f78c-4015-82de-967021ef2edd service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:29.453822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1057/2114] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:29.488717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829dede-5eea-4f40-84c4-838c32b596dc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:29.496157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22436755-cd19-4738-8dfd-6369eb08d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:29.497178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22436755-cd19-4738-8dfd-6369eb08d9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:29.497767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22436755-cd19-4738-8dfd-6369eb08d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:29.498122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22436755-cd19-4738-8dfd-6369eb08d9d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:29.499134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22436755-cd19-4738-8dfd-6369eb08d9d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:29.502080 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22436755-cd19-4738-8dfd-6369eb08d9d2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:29.533822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1058/2115] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:29 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:00:29.540132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979848-f78c-4015-82de-967021ef2edd service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:29.557198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979848-f78c-4015-82de-967021ef2edd service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:29.567275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db852e08-a778-48d4-bda9-c77080c9f220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:29.568503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db852e08-a778-48d4-bda9-c77080c9f220 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:29.569068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db852e08-a778-48d4-bda9-c77080c9f220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:29.569671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db852e08-a778-48d4-bda9-c77080c9f220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:29.571100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db852e08-a778-48d4-bda9-c77080c9f220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:29.574237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db852e08-a778-48d4-bda9-c77080c9f220 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:29.593003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1058/2116] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:00:29.598901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22436755-cd19-4738-8dfd-6369eb08d9d2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:29.612019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22436755-cd19-4738-8dfd-6369eb08d9d2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:29.618515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780765a-783c-4ea1-9b22-fca7c5322ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:29.619370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780765a-783c-4ea1-9b22-fca7c5322ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:29.619664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780765a-783c-4ea1-9b22-fca7c5322ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:29.619959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780765a-783c-4ea1-9b22-fca7c5322ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:29.620735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780765a-783c-4ea1-9b22-fca7c5322ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:29.622425 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780765a-783c-4ea1-9b22-fca7c5322ac8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:29.640481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1059/2117] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:29.647787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db852e08-a778-48d4-bda9-c77080c9f220 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:29.659153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db852e08-a778-48d4-bda9-c77080c9f220 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:29.665919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01f315-7473-4490-aeb2-64638c93897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:29.667143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01f315-7473-4490-aeb2-64638c93897d admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:29.667650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01f315-7473-4490-aeb2-64638c93897d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:29.667650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01f315-7473-4490-aeb2-64638c93897d admin admin] PATH_INFO: `/v3/projects/0fcf0cf43d9f4d469f20cf5341f64fc9/users/ba6c0e159ca74054b004816d7fad943c/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:29.671943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:29.689487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01f315-7473-4490-aeb2-64638c93897d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcf0cf43d9f4d469f20cf5341f64fc9, user_id=ba6c0e159ca74054b004816d7fad943c, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:29.693524 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01f315-7473-4490-aeb2-64638c93897d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:29.715408 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1059/2118] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:29 2022] PUT /identity/v3/projects/0fcf0cf43d9f4d469f20cf5341f64fc9/users/ba6c0e159ca74054b004816d7fad943c/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:29.744437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a38b27-4724-497f-a136-f270b93ce96a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:29.744943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a38b27-4724-497f-a136-f270b93ce96a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:29.745808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a38b27-4724-497f-a136-f270b93ce96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:29.772234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:29.806187 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a7a38b27-4724-497f-a136-f270b93ce96a None None] MFA Rules not processed for user `ba6c0e159ca74054b004816d7fad943c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:29.809280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a7a38b27-4724-497f-a136-f270b93ce96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:29.909920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1060/2119] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:29.918851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01f315-7473-4490-aeb2-64638c93897d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:30.062261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01f315-7473-4490-aeb2-64638c93897d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:30.086868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142dc98-d6f0-4aa7-b633-099521da68ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:30.091120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142dc98-d6f0-4aa7-b633-099521da68ad admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:30.096023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142dc98-d6f0-4aa7-b633-099521da68ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:30.096755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142dc98-d6f0-4aa7-b633-099521da68ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:30.098467 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142dc98-d6f0-4aa7-b633-099521da68ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:30.103258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142dc98-d6f0-4aa7-b633-099521da68ad admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:30.163265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1060/2120] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:29 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:30.169192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a38b27-4724-497f-a136-f270b93ce96a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:30.195876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a38b27-4724-497f-a136-f270b93ce96a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:30.263584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142dc98-d6f0-4aa7-b633-099521da68ad admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:30.302082 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917ce28-fb79-4d8f-a557-253f15dc1425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:30.302827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917ce28-fb79-4d8f-a557-253f15dc1425 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:30.303124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917ce28-fb79-4d8f-a557-253f15dc1425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:30.303449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917ce28-fb79-4d8f-a557-253f15dc1425 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:30.304440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917ce28-fb79-4d8f-a557-253f15dc1425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:30.307193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917ce28-fb79-4d8f-a557-253f15dc1425 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:30.338822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1061/2121] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:30 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:00:30.344067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917ce28-fb79-4d8f-a557-253f15dc1425 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:30.356921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917ce28-fb79-4d8f-a557-253f15dc1425 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:30.361709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142dc98-d6f0-4aa7-b633-099521da68ad admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:30.362502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94800c-1d94-41ba-a427-dfb2d65a3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:30.363115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94800c-1d94-41ba-a427-dfb2d65a3985 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:30.363434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94800c-1d94-41ba-a427-dfb2d65a3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:30.363718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94800c-1d94-41ba-a427-dfb2d65a3985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:30.364474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94800c-1d94-41ba-a427-dfb2d65a3985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:30.367154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94800c-1d94-41ba-a427-dfb2d65a3985 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:30.369989 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da269a69-fdf1-4014-af8a-b0d90573a105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:30.371059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da269a69-fdf1-4014-af8a-b0d90573a105 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:30.371923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da269a69-fdf1-4014-af8a-b0d90573a105 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:30.372162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da269a69-fdf1-4014-af8a-b0d90573a105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:30.375818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-da269a69-fdf1-4014-af8a-b0d90573a105 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:30.381386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1062/2122] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:00:30.387291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94800c-1d94-41ba-a427-dfb2d65a3985 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:30.401929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94800c-1d94-41ba-a427-dfb2d65a3985 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:30.432160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b352a27-cf26-43b5-a91d-2aebe17c107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:30.434399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b352a27-cf26-43b5-a91d-2aebe17c107d admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:30.434399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b352a27-cf26-43b5-a91d-2aebe17c107d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:30.434854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b352a27-cf26-43b5-a91d-2aebe17c107d admin admin] PATH_INFO: `/v3/projects/351596e7c3544106bfdfa6fdab01d741/users/d51a08991b514431a9201c030d410f69/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:30.485839 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b352a27-cf26-43b5-a91d-2aebe17c107d admin admin] RBAC: Authorizing `identity:create_grant(project_id=351596e7c3544106bfdfa6fdab01d741, user_id=d51a08991b514431a9201c030d410f69, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:30.488770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b352a27-cf26-43b5-a91d-2aebe17c107d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:30.504774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da269a69-fdf1-4014-af8a-b0d90573a105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:30.514024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da269a69-fdf1-4014-af8a-b0d90573a105 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:30.519298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1063/2123] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:30 2022] PUT /identity/v3/projects/351596e7c3544106bfdfa6fdab01d741/users/d51a08991b514431a9201c030d410f69/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:30.524770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b352a27-cf26-43b5-a91d-2aebe17c107d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:30.551743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1061/2124] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:00:30.658328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:30.700221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b352a27-cf26-43b5-a91d-2aebe17c107d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:30.718511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e21a8-f51e-4fff-be19-1b8cedc1fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:30.719354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e21a8-f51e-4fff-be19-1b8cedc1fd68 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:30.719731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e21a8-f51e-4fff-be19-1b8cedc1fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:30.720100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e21a8-f51e-4fff-be19-1b8cedc1fd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:30.720978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e21a8-f51e-4fff-be19-1b8cedc1fd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:30.722930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e21a8-f51e-4fff-be19-1b8cedc1fd68 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:30.756046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1064/2125] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:30.762896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da269a69-fdf1-4014-af8a-b0d90573a105 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:30.797459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da269a69-fdf1-4014-af8a-b0d90573a105 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:30.824368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd8f84-f447-4800-9472-d3d1df2d6d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:30.826258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd8f84-f447-4800-9472-d3d1df2d6d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:30.827258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd8f84-f447-4800-9472-d3d1df2d6d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:30.827840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd8f84-f447-4800-9472-d3d1df2d6d28 admin admin] PATH_INFO: `/v3/projects/351596e7c3544106bfdfa6fdab01d741/users/d51a08991b514431a9201c030d410f69/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:30.832880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd8f84-f447-4800-9472-d3d1df2d6d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351596e7c3544106bfdfa6fdab01d741, user_id=d51a08991b514431a9201c030d410f69, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:30.837722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd8f84-f447-4800-9472-d3d1df2d6d28 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:30.862927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1062/2126] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:30 2022] PUT /identity/v3/projects/351596e7c3544106bfdfa6fdab01d741/users/d51a08991b514431a9201c030d410f69/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:30.874391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf21d-1111-484f-8cac-3f421ef0d319 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:30.874693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf21d-1111-484f-8cac-3f421ef0d319 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:30.874971 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf21d-1111-484f-8cac-3f421ef0d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:30.904497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd8f84-f447-4800-9472-d3d1df2d6d28 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:30.924711 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:30.924980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8d8cf21d-1111-484f-8cac-3f421ef0d319 None None] MFA Rules not processed for user `d51a08991b514431a9201c030d410f69`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:30.924980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8d8cf21d-1111-484f-8cac-3f421ef0d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:31.048982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd8f84-f447-4800-9472-d3d1df2d6d28 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:31.052902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1065/2127] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:31.058899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe6529-3167-4518-9a27-03772356dca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:31.059632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe6529-3167-4518-9a27-03772356dca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:31.059909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe6529-3167-4518-9a27-03772356dca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:31.060198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe6529-3167-4518-9a27-03772356dca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:31.062286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-88fe6529-3167-4518-9a27-03772356dca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:31.065388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cf21d-1111-484f-8cac-3f421ef0d319 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:31.076952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cf21d-1111-484f-8cac-3f421ef0d319 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:31.081493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb36313-8d7b-4e94-9bc3-91db811e8185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:31.082256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb36313-8d7b-4e94-9bc3-91db811e8185 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:31.082604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb36313-8d7b-4e94-9bc3-91db811e8185 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:31.082951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb36313-8d7b-4e94-9bc3-91db811e8185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:31.157110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb36313-8d7b-4e94-9bc3-91db811e8185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:31.160284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb36313-8d7b-4e94-9bc3-91db811e8185 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:31.168518 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe6529-3167-4518-9a27-03772356dca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:31.171008 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe6529-3167-4518-9a27-03772356dca4 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:31.177899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1066/2128] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:00:31.190466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1063/2129] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:00:32.172998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb36313-8d7b-4e94-9bc3-91db811e8185 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:32.175962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cb36313-8d7b-4e94-9bc3-91db811e8185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:32.289715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb36313-8d7b-4e94-9bc3-91db811e8185 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:32.297867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:32.299637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:32.300151 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:32.300658 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] PATH_INFO: `/v3/users/94e1790824b646e79298903e090dcadb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:32.303253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e1790824b646e79298903e090dcadb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:32.306439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:32.334067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:32.392148 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e1790824b646e79298903e090dcadb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:32.409114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e1790824b646e79298903e090dcadb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:32.422305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e1790824b646e79298903e090dcadb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:32.423373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e1790824b646e79298903e090dcadb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:32.437128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e1790824b646e79298903e090dcadb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:32.448237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1067/2130] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:32 2022] DELETE /identity/v3/users/94e1790824b646e79298903e090dcadb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:32.454891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de1dca-5400-457a-88d7-d73a6e945cea None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:32.455837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de1dca-5400-457a-88d7-d73a6e945cea None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:32.455837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de1dca-5400-457a-88d7-d73a6e945cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:32.478529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-96de1dca-5400-457a-88d7-d73a6e945cea None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:32.480084 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-96de1dca-5400-457a-88d7-d73a6e945cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:32.558898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1064/2131] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:32.569914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:32.571591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:32.645703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72214f-6520-4968-b07c-fe129dbf6c2b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:32.650597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ed139-4439-46e5-8227-b5c2c40f5b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:32.651631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed139-4439-46e5-8227-b5c2c40f5b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:32.651846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed139-4439-46e5-8227-b5c2c40f5b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:32.652123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed139-4439-46e5-8227-b5c2c40f5b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:32.676919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ed139-4439-46e5-8227-b5c2c40f5b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:32.679567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ed139-4439-46e5-8227-b5c2c40f5b46 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:32.695044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1068/2132] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:00:33.135917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de1dca-5400-457a-88d7-d73a6e945cea None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:33.139077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-96de1dca-5400-457a-88d7-d73a6e945cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:33.161594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ed139-4439-46e5-8227-b5c2c40f5b46 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:33.164208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e68ed139-4439-46e5-8227-b5c2c40f5b46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:33.164878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de1dca-5400-457a-88d7-d73a6e945cea None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:33.183693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:33.187596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:33.188911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:33.191610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] PATH_INFO: `/v3/users/e7739b2097524ff8a31720395de4edc5` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:33.200515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7739b2097524ff8a31720395de4edc5)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:33.208285 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:33.223236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ed139-4439-46e5-8227-b5c2c40f5b46 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:33.262515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:33.270158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:33.270688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:33.271155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] PATH_INFO: `/v3/projects/176af844e237427abf9b735e97142547` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:33.299383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=176af844e237427abf9b735e97142547)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:33.309745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:33.420498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7739b2097524ff8a31720395de4edc5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.434112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176af844e237427abf9b735e97142547', 'request_id': 'req-0b538344-146d-4a9f-96cc-b5633727c43c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.442688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176af844e237427abf9b735e97142547', 'request_id': 'req-0b538344-146d-4a9f-96cc-b5633727c43c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.447149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:33.453960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176af844e237427abf9b735e97142547', 'request_id': 'req-0b538344-146d-4a9f-96cc-b5633727c43c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.467081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7739b2097524ff8a31720395de4edc5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.470181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7739b2097524ff8a31720395de4edc5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.485826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] The token cache is being invalidate because project 176af844e237427abf9b735e97142547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:33.486190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.487082 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.493100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1069/2133] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:33 2022] DELETE /identity/v3/projects/176af844e237427abf9b735e97142547 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:33.495015 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7739b2097524ff8a31720395de4edc5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.497181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:33.498110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5b477328-ecd8-49da-8b6c-d5f6da388256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7739b2097524ff8a31720395de4edc5'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.499997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:33.541512 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1065/2134] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:33 2022] DELETE /identity/v3/users/e7739b2097524ff8a31720395de4edc5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:33.553247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585361d-5417-4e35-a1a4-8f664dd915a3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:33.555474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585361d-5417-4e35-a1a4-8f664dd915a3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:33.556138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585361d-5417-4e35-a1a4-8f664dd915a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:33.558508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:33.620078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4585361d-5417-4e35-a1a4-8f664dd915a3 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:33.620574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4585361d-5417-4e35-a1a4-8f664dd915a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:33.691810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538344-146d-4a9f-96cc-b5633727c43c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:33.745289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1066/2135] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:33.746463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585361d-5417-4e35-a1a4-8f664dd915a3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:33.749439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4585361d-5417-4e35-a1a4-8f664dd915a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:33.826237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:33.829316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:33.829316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:33.829316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] PATH_INFO: `/v3/users/ffde5affd2154266a63dc36ea3087c43` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:33.830212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffde5affd2154266a63dc36ea3087c43)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:33.832656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:33.863257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585361d-5417-4e35-a1a4-8f664dd915a3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:33.876308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf426dd-1b33-4186-b837-71a7aa710a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:33.877483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf426dd-1b33-4186-b837-71a7aa710a5d service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:33.878002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf426dd-1b33-4186-b837-71a7aa710a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:33.878538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf426dd-1b33-4186-b837-71a7aa710a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:33.882065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-edf426dd-1b33-4186-b837-71a7aa710a5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:33.927275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffde5affd2154266a63dc36ea3087c43'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.945119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffde5affd2154266a63dc36ea3087c43'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.955495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffde5affd2154266a63dc36ea3087c43'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.956312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffde5affd2154266a63dc36ea3087c43'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.964723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffde5affd2154266a63dc36ea3087c43'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:33.973372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf426dd-1b33-4186-b837-71a7aa710a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:33.977118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1070/2136] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:33 2022] DELETE /identity/v3/users/ffde5affd2154266a63dc36ea3087c43 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:33.978060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf426dd-1b33-4186-b837-71a7aa710a5d service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:33.978466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:33.980333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:33.989954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1067/2137] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:34.086989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:34.115600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9dc63-53b8-4bff-99d4-faa317d204bd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:34.122608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dff2f-b3ba-46c9-b88c-8fe80ebe2c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:34.123789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dff2f-b3ba-46c9-b88c-8fe80ebe2c0e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:34.125879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dff2f-b3ba-46c9-b88c-8fe80ebe2c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:34.125879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dff2f-b3ba-46c9-b88c-8fe80ebe2c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:34.129159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-470dff2f-b3ba-46c9-b88c-8fe80ebe2c0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:34.348849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dff2f-b3ba-46c9-b88c-8fe80ebe2c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:34.353123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dff2f-b3ba-46c9-b88c-8fe80ebe2c0e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:34.380112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1071/2138] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:34.695952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf426dd-1b33-4186-b837-71a7aa710a5d service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:34.702983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-edf426dd-1b33-4186-b837-71a7aa710a5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:34.759629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf426dd-1b33-4186-b837-71a7aa710a5d service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:34.789405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:34.789884 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:34.790175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:34.790454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] PATH_INFO: `/v3/projects/6861245a2a224653aefc8cfb5e9b03ce` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:34.792116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6861245a2a224653aefc8cfb5e9b03ce)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:34.794373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:34.826212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:34.870681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6861245a2a224653aefc8cfb5e9b03ce', 'request_id': 'req-7d135342-860f-420b-9af1-49730079fa2d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:34.880867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6861245a2a224653aefc8cfb5e9b03ce', 'request_id': 'req-7d135342-860f-420b-9af1-49730079fa2d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:34.900255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6861245a2a224653aefc8cfb5e9b03ce', 'request_id': 'req-7d135342-860f-420b-9af1-49730079fa2d'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:34.925333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] The token cache is being invalidate because project 6861245a2a224653aefc8cfb5e9b03ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:34.925653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:34.926525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7d135342-860f-420b-9af1-49730079fa2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:34.937694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792ba7-6f4b-4684-bdd7-067663eb64cf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:34.937993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792ba7-6f4b-4684-bdd7-067663eb64cf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:34.938285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792ba7-6f4b-4684-bdd7-067663eb64cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:34.939756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1068/2139] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:34 2022] DELETE /identity/v3/projects/6861245a2a224653aefc8cfb5e9b03ce => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:34.988721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e9792ba7-6f4b-4684-bdd7-067663eb64cf None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:34.992229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e9792ba7-6f4b-4684-bdd7-067663eb64cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:35.264346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1072/2140] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:35.280503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd531-f015-4a1f-860b-09beca922ca4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:35.280978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd531-f015-4a1f-860b-09beca922ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:35.281770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd531-f015-4a1f-860b-09beca922ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:35.341693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9792ba7-6f4b-4684-bdd7-067663eb64cf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:35.344242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e9792ba7-6f4b-4684-bdd7-067663eb64cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:35.364088 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-198fd531-f015-4a1f-860b-09beca922ca4 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:35.373390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-198fd531-f015-4a1f-860b-09beca922ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:35.399069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1069/2141] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:35.401166 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fd531-f015-4a1f-860b-09beca922ca4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:35.426612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fd531-f015-4a1f-860b-09beca922ca4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:35.441722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4728ae-a8a2-451c-99a9-c254dfa791f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:35.442960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4728ae-a8a2-451c-99a9-c254dfa791f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:35.443554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4728ae-a8a2-451c-99a9-c254dfa791f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:35.444736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4728ae-a8a2-451c-99a9-c254dfa791f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:35.448161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4728ae-a8a2-451c-99a9-c254dfa791f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:35.448726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4728ae-a8a2-451c-99a9-c254dfa791f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:35.453683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4728ae-a8a2-451c-99a9-c254dfa791f8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:35.483785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1070/2142] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:35.494123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4728ae-a8a2-451c-99a9-c254dfa791f8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:35.500365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9b4728ae-a8a2-451c-99a9-c254dfa791f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:35.523236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9792ba7-6f4b-4684-bdd7-067663eb64cf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:35.531590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7c495-4680-4349-87e1-59e3d2a930b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:35.532638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7c495-4680-4349-87e1-59e3d2a930b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:35.534293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7c495-4680-4349-87e1-59e3d2a930b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:35.534684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7c495-4680-4349-87e1-59e3d2a930b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:35.536519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4728ae-a8a2-451c-99a9-c254dfa791f8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:35.543642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-97e7c495-4680-4349-87e1-59e3d2a930b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:35.549930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:35.551632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:35.552175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:35.552803 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] PATH_INFO: `/v3/projects/725e038faada422c9ffab287dd601e90` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:35.556492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=725e038faada422c9ffab287dd601e90)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:35.562643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:35.643099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:35.676736 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '725e038faada422c9ffab287dd601e90', 'request_id': 'req-e3350c97-6c60-4cb7-b438-8607cb48a63b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:35.687656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '725e038faada422c9ffab287dd601e90', 'request_id': 'req-e3350c97-6c60-4cb7-b438-8607cb48a63b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:35.701811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '725e038faada422c9ffab287dd601e90', 'request_id': 'req-e3350c97-6c60-4cb7-b438-8607cb48a63b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:35.703193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7c495-4680-4349-87e1-59e3d2a930b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:35.706130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7c495-4680-4349-87e1-59e3d2a930b4 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:35.720015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1073/2143] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:35.720998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] The token cache is being invalidate because project 725e038faada422c9ffab287dd601e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:35.721291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7c495-4680-4349-87e1-59e3d2a930b4 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:35.721463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:35.722257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:35.724254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1071/2144] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:35 2022] DELETE /identity/v3/projects/725e038faada422c9ffab287dd601e90 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:35.731862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:35.734370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:35.741018 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7c495-4680-4349-87e1-59e3d2a930b4 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:35.828540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf98ba-9dad-492c-a7b3-465c35581938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:35.829235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf98ba-9dad-492c-a7b3-465c35581938 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:35.829618 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf98ba-9dad-492c-a7b3-465c35581938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:35.829902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf98ba-9dad-492c-a7b3-465c35581938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:35.830613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf98ba-9dad-492c-a7b3-465c35581938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:35.832620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf98ba-9dad-492c-a7b3-465c35581938 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:35.856217 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3350c97-6c60-4cb7-b438-8607cb48a63b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:35.861623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:35.862565 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:35.863002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:35.863204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] PATH_INFO: `/v3/users/a46434562cd34c32b6e8c8978efa6d35` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:35.864498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46434562cd34c32b6e8c8978efa6d35)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:35.867149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:35.875702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1074/2145] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:35 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:35.884288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf98ba-9dad-492c-a7b3-465c35581938 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:35.887742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:35.888809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8ddf98ba-9dad-492c-a7b3-465c35581938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:35.947098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46434562cd34c32b6e8c8978efa6d35'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:35.969676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46434562cd34c32b6e8c8978efa6d35'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:35.971073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46434562cd34c32b6e8c8978efa6d35'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:35.984937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46434562cd34c32b6e8c8978efa6d35'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:35.986174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46434562cd34c32b6e8c8978efa6d35'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:36.008038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1072/2146] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:35 2022] DELETE /identity/v3/users/a46434562cd34c32b6e8c8978efa6d35 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:36.009001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf98ba-9dad-492c-a7b3-465c35581938 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:36.127855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a3c69-773b-4655-950c-2ab2bf06a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:36.130559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a3c69-773b-4655-950c-2ab2bf06a4bd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:36.131691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a3c69-773b-4655-950c-2ab2bf06a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:36.133257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a3c69-773b-4655-950c-2ab2bf06a4bd admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:36.134990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a3c69-773b-4655-950c-2ab2bf06a4bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:36.138757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a3c69-773b-4655-950c-2ab2bf06a4bd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:36.158261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:36.182089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1075/2147] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:35 2022] POST /identity/v3/users => generated 287 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:36.188097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:36.190674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:36.221485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b288d-4d5b-4338-bcde-a7a5e8ec5434 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:36.239325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b9fa-2d4b-4a93-9611-f886d7f86714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:36.240344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b9fa-2d4b-4a93-9611-f886d7f86714 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:36.240771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b9fa-2d4b-4a93-9611-f886d7f86714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:36.241781 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570b9fa-2d4b-4a93-9611-f886d7f86714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:36.242813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570b9fa-2d4b-4a93-9611-f886d7f86714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:36.245914 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570b9fa-2d4b-4a93-9611-f886d7f86714 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:36.271222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1073/2148] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:00:36.277395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a3c69-773b-4655-950c-2ab2bf06a4bd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:36.295023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a3c69-773b-4655-950c-2ab2bf06a4bd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:36.303592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997b93-7d2f-4ee0-a590-9545c73fae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:36.304677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997b93-7d2f-4ee0-a590-9545c73fae9f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:36.305527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997b93-7d2f-4ee0-a590-9545c73fae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:36.305999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997b93-7d2f-4ee0-a590-9545c73fae9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:36.307492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997b93-7d2f-4ee0-a590-9545c73fae9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:36.310530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997b93-7d2f-4ee0-a590-9545c73fae9f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:36.331442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1076/2149] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:36.337925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b9fa-2d4b-4a93-9611-f886d7f86714 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:36.365208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570b9fa-2d4b-4a93-9611-f886d7f86714 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:36.368554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f437764-9fba-4069-8580-3e93dba4917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:36.370001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f437764-9fba-4069-8580-3e93dba4917f admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:36.370425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f437764-9fba-4069-8580-3e93dba4917f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:36.370831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f437764-9fba-4069-8580-3e93dba4917f admin admin] PATH_INFO: `/v3/projects/8ed8d7d52654430eb931fa2044b3eb5e/users/08cfd881189340ac9d32fee702baf5c6/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:36.410928 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997b93-7d2f-4ee0-a590-9545c73fae9f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:36.414944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5c997b93-7d2f-4ee0-a590-9545c73fae9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:36.425817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f437764-9fba-4069-8580-3e93dba4917f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed8d7d52654430eb931fa2044b3eb5e, user_id=08cfd881189340ac9d32fee702baf5c6, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:36.432623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f437764-9fba-4069-8580-3e93dba4917f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:36.450878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997b93-7d2f-4ee0-a590-9545c73fae9f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:36.460614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:36.461695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:36.461975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:36.462254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] PATH_INFO: `/v3/users/89e779d96a0a419e9c57570b981a8ab3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:36.464446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e779d96a0a419e9c57570b981a8ab3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:36.466880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:36.470476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1074/2150] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:36 2022] PUT /identity/v3/projects/8ed8d7d52654430eb931fa2044b3eb5e/users/08cfd881189340ac9d32fee702baf5c6/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:36.484936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa4842-948f-406b-ab76-e3eda4856f92 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:36.485757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa4842-948f-406b-ab76-e3eda4856f92 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:36.486788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa4842-948f-406b-ab76-e3eda4856f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:36.556559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fffa4842-948f-406b-ab76-e3eda4856f92 None None] MFA Rules not processed for user `08cfd881189340ac9d32fee702baf5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:36.557795 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e779d96a0a419e9c57570b981a8ab3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:36.560748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fffa4842-948f-406b-ab76-e3eda4856f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:36.580277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e779d96a0a419e9c57570b981a8ab3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:36.598086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e779d96a0a419e9c57570b981a8ab3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:36.599507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e779d96a0a419e9c57570b981a8ab3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:36.620637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-691338ef-cf45-4ade-8348-f7758c115f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e779d96a0a419e9c57570b981a8ab3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:36.634022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1077/2151] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:36 2022] DELETE /identity/v3/users/89e779d96a0a419e9c57570b981a8ab3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:36.641189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79394ab-f734-4309-89ac-85fb89e7bdb0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:36.642742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79394ab-f734-4309-89ac-85fb89e7bdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:36.643874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79394ab-f734-4309-89ac-85fb89e7bdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:36.670986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c79394ab-f734-4309-89ac-85fb89e7bdb0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:36.673614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c79394ab-f734-4309-89ac-85fb89e7bdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:36.773311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1075/2152] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:36.776869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa4842-948f-406b-ab76-e3eda4856f92 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:36.780793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fffa4842-948f-406b-ab76-e3eda4856f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:36.790161 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1078/2153] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:36.791229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79394ab-f734-4309-89ac-85fb89e7bdb0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:36.792767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c79394ab-f734-4309-89ac-85fb89e7bdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:36.887261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:36.922801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa4842-948f-406b-ab76-e3eda4856f92 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:36.925635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79394ab-f734-4309-89ac-85fb89e7bdb0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:36.935669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:36.935906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583395c5-5ed8-41bc-8269-156c64134011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:36.936618 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583395c5-5ed8-41bc-8269-156c64134011 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:36.936922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583395c5-5ed8-41bc-8269-156c64134011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:36.937196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583395c5-5ed8-41bc-8269-156c64134011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:36.937992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:36.938611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:36.939469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] PATH_INFO: `/v3/projects/2054c8f088714ad480f686bc5e89a207` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:36.943823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2054c8f088714ad480f686bc5e89a207)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:36.948280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:36.961797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:37.034243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2054c8f088714ad480f686bc5e89a207', 'request_id': 'req-085b2f02-90a6-4879-85e3-fb46a6d9f466'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:37.044482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2054c8f088714ad480f686bc5e89a207', 'request_id': 'req-085b2f02-90a6-4879-85e3-fb46a6d9f466'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:37.045990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583395c5-5ed8-41bc-8269-156c64134011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:37.047587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583395c5-5ed8-41bc-8269-156c64134011 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:37.056063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2054c8f088714ad480f686bc5e89a207', 'request_id': 'req-085b2f02-90a6-4879-85e3-fb46a6d9f466'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:37.061995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1079/2154] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:37.063909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583395c5-5ed8-41bc-8269-156c64134011 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:37.067720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-583395c5-5ed8-41bc-8269-156c64134011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:37.071875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] The token cache is being invalidate because project 2054c8f088714ad480f686bc5e89a207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:37.072284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:37.073133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-085b2f02-90a6-4879-85e3-fb46a6d9f466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:37.080963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1076/2155] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:36 2022] DELETE /identity/v3/projects/2054c8f088714ad480f686bc5e89a207 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:37.083608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed69c-5b4f-4191-8160-7f1674e54a7e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:37.083813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed69c-5b4f-4191-8160-7f1674e54a7e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:37.084125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed69c-5b4f-4191-8160-7f1674e54a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:37.116482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bbaed69c-5b4f-4191-8160-7f1674e54a7e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:37.118648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bbaed69c-5b4f-4191-8160-7f1674e54a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:37.206400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583395c5-5ed8-41bc-8269-156c64134011 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:37.239358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1077/2156] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:37.259431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f31a7b-e0e8-43fa-843f-3cbf440169fe None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:37.260124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f31a7b-e0e8-43fa-843f-3cbf440169fe None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:37.260692 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f31a7b-e0e8-43fa-843f-3cbf440169fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:37.308605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f67dfb-de07-4c15-9d42-22c164bf8489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:37.309287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67dfb-de07-4c15-9d42-22c164bf8489 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:37.309609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67dfb-de07-4c15-9d42-22c164bf8489 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:37.309895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67dfb-de07-4c15-9d42-22c164bf8489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:37.312759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-36f67dfb-de07-4c15-9d42-22c164bf8489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:37.329587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-31f31a7b-e0e8-43fa-843f-3cbf440169fe None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:37.333292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f67dfb-de07-4c15-9d42-22c164bf8489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:37.335696 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f67dfb-de07-4c15-9d42-22c164bf8489 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:37.335998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-31f31a7b-e0e8-43fa-843f-3cbf440169fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:37.348856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1080/2157] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:37.359600 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1078/2158] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:37.370635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f67dfb-de07-4c15-9d42-22c164bf8489 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:37.391274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f67dfb-de07-4c15-9d42-22c164bf8489 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:37.399419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983def5f-9ab1-481b-8d27-fded13427a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:37.400386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983def5f-9ab1-481b-8d27-fded13427a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:37.400386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983def5f-9ab1-481b-8d27-fded13427a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:37.400747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983def5f-9ab1-481b-8d27-fded13427a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:37.401494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983def5f-9ab1-481b-8d27-fded13427a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:37.401813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983def5f-9ab1-481b-8d27-fded13427a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:37.403612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983def5f-9ab1-481b-8d27-fded13427a2a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:37.420940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1081/2159] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:37.428644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f31a7b-e0e8-43fa-843f-3cbf440169fe None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:37.471966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f31a7b-e0e8-43fa-843f-3cbf440169fe None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:37.487652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7634-c787-4239-bc95-a8b437044391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:37.489334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7634-c787-4239-bc95-a8b437044391 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:37.490074 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7634-c787-4239-bc95-a8b437044391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:37.491376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7634-c787-4239-bc95-a8b437044391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:37.493006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc7634-c787-4239-bc95-a8b437044391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:37.498943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc7634-c787-4239-bc95-a8b437044391 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:37.607459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1079/2160] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:37 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:37.608091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983def5f-9ab1-481b-8d27-fded13427a2a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:37.627196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983def5f-9ab1-481b-8d27-fded13427a2a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:37.773819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:37.783629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec16021-5f10-4f71-9565-d578561ea477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:37.784681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec16021-5f10-4f71-9565-d578561ea477 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:37.785027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec16021-5f10-4f71-9565-d578561ea477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:37.785412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec16021-5f10-4f71-9565-d578561ea477 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:37.786432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec16021-5f10-4f71-9565-d578561ea477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:37.790054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec16021-5f10-4f71-9565-d578561ea477 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:37.828523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1082/2161] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:37 2022] POST /identity/v3/users => generated 281 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:37.831606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7634-c787-4239-bc95-a8b437044391 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:37.855389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7634-c787-4239-bc95-a8b437044391 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:37.908236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15a14e-1fc4-46bb-a819-0801e360df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:37.909118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15a14e-1fc4-46bb-a819-0801e360df6e admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:37.909472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15a14e-1fc4-46bb-a819-0801e360df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:37.909758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15a14e-1fc4-46bb-a819-0801e360df6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:37.910597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15a14e-1fc4-46bb-a819-0801e360df6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:37.912346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15a14e-1fc4-46bb-a819-0801e360df6e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:37.948074 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec16021-5f10-4f71-9565-d578561ea477 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:37.963833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1080/2162] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:37.980489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec16021-5f10-4f71-9565-d578561ea477 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:37.996828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dfd00-14da-4aee-80a5-fe614101b327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:37.997809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dfd00-14da-4aee-80a5-fe614101b327 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:37.998008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dfd00-14da-4aee-80a5-fe614101b327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:37.998337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dfd00-14da-4aee-80a5-fe614101b327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:37.999233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dfd00-14da-4aee-80a5-fe614101b327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:38.001084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dfd00-14da-4aee-80a5-fe614101b327 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:38.035693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15a14e-1fc4-46bb-a819-0801e360df6e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:38.044166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1083/2163] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:38.061853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15a14e-1fc4-46bb-a819-0801e360df6e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:38.068055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d4b26-5156-45bd-959a-e3bd94a67a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:38.069353 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d4b26-5156-45bd-959a-e3bd94a67a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:38.069694 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d4b26-5156-45bd-959a-e3bd94a67a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:38.070065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d4b26-5156-45bd-959a-e3bd94a67a17 admin admin] PATH_INFO: `/v3/projects/dd1a33ba14a149dbae3efc1dfa98ffed/users/62caa62c0f6247ea92be1b2477915221/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:38.106400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d4b26-5156-45bd-959a-e3bd94a67a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1a33ba14a149dbae3efc1dfa98ffed, user_id=62caa62c0f6247ea92be1b2477915221, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:38.110922 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d4b26-5156-45bd-959a-e3bd94a67a17 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:38.167271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1081/2164] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:38 2022] PUT /identity/v3/projects/dd1a33ba14a149dbae3efc1dfa98ffed/users/62caa62c0f6247ea92be1b2477915221/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:38.187687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dff40-49ed-4e1a-8bd1-5d66ee0ca7e3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:38.187687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dff40-49ed-4e1a-8bd1-5d66ee0ca7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:38.187687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dff40-49ed-4e1a-8bd1-5d66ee0ca7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:38.252182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-499dff40-49ed-4e1a-8bd1-5d66ee0ca7e3 None None] MFA Rules not processed for user `62caa62c0f6247ea92be1b2477915221`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:38.254373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-499dff40-49ed-4e1a-8bd1-5d66ee0ca7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:38.282253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d4b26-5156-45bd-959a-e3bd94a67a17 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:38.284430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ec8d4b26-5156-45bd-959a-e3bd94a67a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:38.314275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:38.401368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1084/2165] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:38.440790 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dff40-49ed-4e1a-8bd1-5d66ee0ca7e3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:38.445895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-499dff40-49ed-4e1a-8bd1-5d66ee0ca7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:38.471513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d4b26-5156-45bd-959a-e3bd94a67a17 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:38.480275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:38.481945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:38.482670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:38.483294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] PATH_INFO: `/v3/projects/e14023b089e64950a499df92a7d0eeed` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:38.488112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14023b089e64950a499df92a7d0eeed)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:38.491663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:38.598508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14023b089e64950a499df92a7d0eeed', 'request_id': 'req-6208017b-f939-435f-bdb9-54eda70c8b00'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:38.619204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14023b089e64950a499df92a7d0eeed', 'request_id': 'req-6208017b-f939-435f-bdb9-54eda70c8b00'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:38.625929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dff40-49ed-4e1a-8bd1-5d66ee0ca7e3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:38.636585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14023b089e64950a499df92a7d0eeed', 'request_id': 'req-6208017b-f939-435f-bdb9-54eda70c8b00'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:38.668896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] The token cache is being invalidate because project e14023b089e64950a499df92a7d0eeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:38.669216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:38.670807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:38.681794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1082/2166] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:38 2022] DELETE /identity/v3/projects/e14023b089e64950a499df92a7d0eeed => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:38.683793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:38.686526 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:38.785520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07865279-d13a-43a7-9b73-df88e795650b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:38.788555 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07865279-d13a-43a7-9b73-df88e795650b service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:38.789583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07865279-d13a-43a7-9b73-df88e795650b service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:38.795265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07865279-d13a-43a7-9b73-df88e795650b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:38.800816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-07865279-d13a-43a7-9b73-df88e795650b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:38.915924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:38.927965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208017b-f939-435f-bdb9-54eda70c8b00 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:38.943804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:38.946237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:38.948448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:38.949117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] PATH_INFO: `/v3/users/da0ee1f201794874876624bf8b6c7401` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:38.953052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0ee1f201794874876624bf8b6c7401)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:38.955410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:39.001377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07865279-d13a-43a7-9b73-df88e795650b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:39.003023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07865279-d13a-43a7-9b73-df88e795650b service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:39.016409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1085/2167] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:00:39.018114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07865279-d13a-43a7-9b73-df88e795650b service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:39.020072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-07865279-d13a-43a7-9b73-df88e795650b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:39.050413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:39.053054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07865279-d13a-43a7-9b73-df88e795650b service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:39.055544 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0ee1f201794874876624bf8b6c7401'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.063618 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:39.065265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:39.066077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:39.066242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] PATH_INFO: `/v3/users/32e11de5c55f4facb6f67b06bfa6e3f6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:39.068543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e11de5c55f4facb6f67b06bfa6e3f6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:39.072689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:39.079378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0ee1f201794874876624bf8b6c7401'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.081189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0ee1f201794874876624bf8b6c7401'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.104443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0ee1f201794874876624bf8b6c7401'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.105591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0ee1f201794874876624bf8b6c7401'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.135760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1083/2168] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:38 2022] DELETE /identity/v3/users/da0ee1f201794874876624bf8b6c7401 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:39.138128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:39.141480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:39.184325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e11de5c55f4facb6f67b06bfa6e3f6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.211560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e11de5c55f4facb6f67b06bfa6e3f6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.229575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e11de5c55f4facb6f67b06bfa6e3f6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.236264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e11de5c55f4facb6f67b06bfa6e3f6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.262280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48703e07-0a9f-4440-b444-bc517b41b5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e11de5c55f4facb6f67b06bfa6e3f6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.273992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1086/2169] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:39 2022] DELETE /identity/v3/users/32e11de5c55f4facb6f67b06bfa6e3f6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:39.276040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490732-d88c-401c-ac49-38058198f2d1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:39.276615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490732-d88c-401c-ac49-38058198f2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:39.277252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25490732-d88c-401c-ac49-38058198f2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:39.300145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-25490732-d88c-401c-ac49-38058198f2d1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:39.300547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53118e6-6a25-4154-92fb-5f109f0a9314 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:39.301700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-25490732-d88c-401c-ac49-38058198f2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:39.478036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1087/2170] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:39.480608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:39.481723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:39.482272 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:39.482738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] PATH_INFO: `/v3/users/62caa62c0f6247ea92be1b2477915221` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:39.484799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62caa62c0f6247ea92be1b2477915221)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:39.487257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:39.497392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25490732-d88c-401c-ac49-38058198f2d1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:39.500244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-25490732-d88c-401c-ac49-38058198f2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:39.600974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62caa62c0f6247ea92be1b2477915221'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.612992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:39.624139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25490732-d88c-401c-ac49-38058198f2d1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:39.627647 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62caa62c0f6247ea92be1b2477915221'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.631219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62caa62c0f6247ea92be1b2477915221'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.638428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d7c7b-da61-469b-a4bb-555939cef381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:39.639254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d7c7b-da61-469b-a4bb-555939cef381 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:39.639581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d7c7b-da61-469b-a4bb-555939cef381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:39.639872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d7c7b-da61-469b-a4bb-555939cef381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:39.645150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:39.655843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62caa62c0f6247ea92be1b2477915221'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.658109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-85fdb6c4-0dd2-4662-bc67-46b3c2924c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62caa62c0f6247ea92be1b2477915221'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:39.675231 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d7c7b-da61-469b-a4bb-555939cef381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:39.677140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d7c7b-da61-469b-a4bb-555939cef381 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:39.697427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1084/2171] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:39 2022] DELETE /identity/v3/users/62caa62c0f6247ea92be1b2477915221 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:39.705711 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc176d-7af5-41f7-b57f-9310958ddd55 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:39.706017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc176d-7af5-41f7-b57f-9310958ddd55 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:39.706287 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc176d-7af5-41f7-b57f-9310958ddd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:39.710632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1088/2172] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:00:39.737673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-50dc176d-7af5-41f7-b57f-9310958ddd55 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:39.742534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-50dc176d-7af5-41f7-b57f-9310958ddd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:39.967766 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1085/2173] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:39.994925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d7c7b-da61-469b-a4bb-555939cef381 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:39.996634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aa7d7c7b-da61-469b-a4bb-555939cef381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:40.021270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d7c7b-da61-469b-a4bb-555939cef381 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:40.114283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfd87d-0458-41ae-a8c5-100c70c2bc9a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:40.114954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfd87d-0458-41ae-a8c5-100c70c2bc9a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:40.115363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfd87d-0458-41ae-a8c5-100c70c2bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:40.156536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-93dfd87d-0458-41ae-a8c5-100c70c2bc9a None None] MFA Rules not processed for user `08cfd881189340ac9d32fee702baf5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:40.163834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-93dfd87d-0458-41ae-a8c5-100c70c2bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:40.238264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0cac2-ab73-4d8d-a6d4-cfae412e69d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:40.239102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0cac2-ab73-4d8d-a6d4-cfae412e69d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:40.239570 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0cac2-ab73-4d8d-a6d4-cfae412e69d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:40.239975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0cac2-ab73-4d8d-a6d4-cfae412e69d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:40.258714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0cac2-ab73-4d8d-a6d4-cfae412e69d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:40.260465 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0cac2-ab73-4d8d-a6d4-cfae412e69d8 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:40.277560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1089/2174] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:40.278436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0cac2-ab73-4d8d-a6d4-cfae412e69d8 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:40.280066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f4b0cac2-ab73-4d8d-a6d4-cfae412e69d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:40.307962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0cac2-ab73-4d8d-a6d4-cfae412e69d8 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:40.312147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1086/2175] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:40.322595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:40.323537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:40.323810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:40.324097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] PATH_INFO: `/v3/projects/ebcb12e3d9294f3b94882c9d1e6cde86` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:40.325616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebcb12e3d9294f3b94882c9d1e6cde86)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:40.327731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:40.469180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebcb12e3d9294f3b94882c9d1e6cde86', 'request_id': 'req-4946b67c-7293-41fd-afa6-f2843f72d30f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:40.497217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebcb12e3d9294f3b94882c9d1e6cde86', 'request_id': 'req-4946b67c-7293-41fd-afa6-f2843f72d30f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:40.520940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebcb12e3d9294f3b94882c9d1e6cde86', 'request_id': 'req-4946b67c-7293-41fd-afa6-f2843f72d30f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:40.589274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] The token cache is being invalidate because project ebcb12e3d9294f3b94882c9d1e6cde86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:40.593573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:40.595608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:40.603967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1090/2176] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:40 2022] DELETE /identity/v3/projects/ebcb12e3d9294f3b94882c9d1e6cde86 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:40.611401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90c5f-5535-4163-927b-9e25a711e513 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:40.611902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90c5f-5535-4163-927b-9e25a711e513 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:40.612415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa90c5f-5535-4163-927b-9e25a711e513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:40.633027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:40.637265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:40.720568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-aaa90c5f-5535-4163-927b-9e25a711e513 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:40.722085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-aaa90c5f-5535-4163-927b-9e25a711e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:40.886621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1087/2177] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:40.889944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946b67c-7293-41fd-afa6-f2843f72d30f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:40.896223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:40.903851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5087eb1-0614-4b5e-bf81-213dfd9649c7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:40.904973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5087eb1-0614-4b5e-bf81-213dfd9649c7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:40.905715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5087eb1-0614-4b5e-bf81-213dfd9649c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:40.911567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:40.911924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:40.912160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] PATH_INFO: `/v3/projects/a8a197f025bd4131aeb30b9b82fa4349` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:40.919265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a197f025bd4131aeb30b9b82fa4349)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:40.921538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:40.963398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d5087eb1-0614-4b5e-bf81-213dfd9649c7 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:40.965398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d5087eb1-0614-4b5e-bf81-213dfd9649c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:40.982502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1088/2178] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:40.985177 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5087eb1-0614-4b5e-bf81-213dfd9649c7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:41.012574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5087eb1-0614-4b5e-bf81-213dfd9649c7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:41.015647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:41.021625 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d320c75-8069-47c5-9bc4-c29872b9a47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:41.024627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d320c75-8069-47c5-9bc4-c29872b9a47c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:41.024627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d320c75-8069-47c5-9bc4-c29872b9a47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:41.024627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d320c75-8069-47c5-9bc4-c29872b9a47c admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:41.026269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d320c75-8069-47c5-9bc4-c29872b9a47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:41.026867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d320c75-8069-47c5-9bc4-c29872b9a47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:41.029860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d320c75-8069-47c5-9bc4-c29872b9a47c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:41.057207 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1089/2179] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:41.067478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d320c75-8069-47c5-9bc4-c29872b9a47c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:41.072730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a197f025bd4131aeb30b9b82fa4349', 'request_id': 'req-75dcecd4-f030-42b5-8c10-c2d490222414'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:41.083559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a197f025bd4131aeb30b9b82fa4349', 'request_id': 'req-75dcecd4-f030-42b5-8c10-c2d490222414'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:41.092683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d320c75-8069-47c5-9bc4-c29872b9a47c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:41.112191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a197f025bd4131aeb30b9b82fa4349', 'request_id': 'req-75dcecd4-f030-42b5-8c10-c2d490222414'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:41.142273 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:41.183529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] The token cache is being invalidate because project a8a197f025bd4131aeb30b9b82fa4349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:41.186982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:41.191336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:41.205458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1091/2180] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:40 2022] DELETE /identity/v3/projects/a8a197f025bd4131aeb30b9b82fa4349 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:41.212127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:41.223652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:41.283649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd0ab-1c81-4c9b-9bf9-12fe2862be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:41.284321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd0ab-1c81-4c9b-9bf9-12fe2862be27 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:41.285825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd0ab-1c81-4c9b-9bf9-12fe2862be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:41.286433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd0ab-1c81-4c9b-9bf9-12fe2862be27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:41.287616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebd0ab-1c81-4c9b-9bf9-12fe2862be27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:41.290752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebd0ab-1c81-4c9b-9bf9-12fe2862be27 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:41.375215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1090/2181] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:41 2022] POST /identity/v3/projects => generated 381 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:41.382610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd0ab-1c81-4c9b-9bf9-12fe2862be27 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:41.385815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d2ebd0ab-1c81-4c9b-9bf9-12fe2862be27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:41.434930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcecd4-f030-42b5-8c10-c2d490222414 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:41.524301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd0ab-1c81-4c9b-9bf9-12fe2862be27 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:41.531833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664fa96-6778-4cac-871f-2cd2e761a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:41.532639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664fa96-6778-4cac-871f-2cd2e761a4bd admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:41.533000 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664fa96-6778-4cac-871f-2cd2e761a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:41.533354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664fa96-6778-4cac-871f-2cd2e761a4bd admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:41.534424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664fa96-6778-4cac-871f-2cd2e761a4bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:41.536865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664fa96-6778-4cac-871f-2cd2e761a4bd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:41.594132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1091/2182] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:41 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:00:41.600276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664fa96-6778-4cac-871f-2cd2e761a4bd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:41.624656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664fa96-6778-4cac-871f-2cd2e761a4bd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:41.627722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:41.630860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:41.632556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:41.632556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] PATH_INFO: `/v3/users/8815992d2a0f41db855d9ebff8cdf08f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:41.635829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8815992d2a0f41db855d9ebff8cdf08f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:41.640519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:41.642757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b15a3-fa74-4ff3-8dfc-d63344e03afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:41.643625 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b15a3-fa74-4ff3-8dfc-d63344e03afe admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:41.644578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b15a3-fa74-4ff3-8dfc-d63344e03afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:41.644578 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b15a3-fa74-4ff3-8dfc-d63344e03afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:41.645195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b15a3-fa74-4ff3-8dfc-d63344e03afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:41.647551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b15a3-fa74-4ff3-8dfc-d63344e03afe admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:41.663763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1092/2183] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:41.671209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b15a3-fa74-4ff3-8dfc-d63344e03afe admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:41.696370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b15a3-fa74-4ff3-8dfc-d63344e03afe admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:41.707584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd59a54-aa73-42f2-9399-f36a6d87cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:41.709068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd59a54-aa73-42f2-9399-f36a6d87cd03 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:41.709829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd59a54-aa73-42f2-9399-f36a6d87cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:41.710856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd59a54-aa73-42f2-9399-f36a6d87cd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:41.713056 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd59a54-aa73-42f2-9399-f36a6d87cd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:41.717167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd59a54-aa73-42f2-9399-f36a6d87cd03 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:41.761689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8815992d2a0f41db855d9ebff8cdf08f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:41.770484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1093/2184] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:41.777754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd59a54-aa73-42f2-9399-f36a6d87cd03 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:41.784969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:41.799826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd59a54-aa73-42f2-9399-f36a6d87cd03 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:41.801012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8815992d2a0f41db855d9ebff8cdf08f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:41.812103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5ea25-50b4-4a87-ba9a-bd6de2b5620a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:41.813210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5ea25-50b4-4a87-ba9a-bd6de2b5620a admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:41.813613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5ea25-50b4-4a87-ba9a-bd6de2b5620a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:41.814002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5ea25-50b4-4a87-ba9a-bd6de2b5620a admin admin] PATH_INFO: `/v3/projects/f88dab3194c04e7abfa792fd5825ce8f/users/d495c8dc1fd24347a82836774ad0509b/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:41.820081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8815992d2a0f41db855d9ebff8cdf08f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:41.821112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8815992d2a0f41db855d9ebff8cdf08f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:41.837307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8815992d2a0f41db855d9ebff8cdf08f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:41.845371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1092/2185] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:41 2022] DELETE /identity/v3/users/8815992d2a0f41db855d9ebff8cdf08f => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:41.846332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:41.847814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:41.880792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5ea25-50b4-4a87-ba9a-bd6de2b5620a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f88dab3194c04e7abfa792fd5825ce8f, user_id=d495c8dc1fd24347a82836774ad0509b, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:41.886903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5ea25-50b4-4a87-ba9a-bd6de2b5620a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:41.951290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1094/2186] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:41 2022] PUT /identity/v3/projects/f88dab3194c04e7abfa792fd5825ce8f/users/d495c8dc1fd24347a82836774ad0509b/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:41.977181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f4190-2028-451d-a7b3-bfa98adb223a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:41.979406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f4190-2028-451d-a7b3-bfa98adb223a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:41.979993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f4190-2028-451d-a7b3-bfa98adb223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:42.108706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9d6f4190-2028-451d-a7b3-bfa98adb223a None None] MFA Rules not processed for user `d495c8dc1fd24347a82836774ad0509b`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:42.110014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9d6f4190-2028-451d-a7b3-bfa98adb223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:42.145214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ef1c5-c8d1-43bd-a663-08151c89897f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:42.217929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:42.328192 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:42.329119 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:42.329406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:42.329689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] PATH_INFO: `/v3/users/252aee53df604f5997b958ce157c4776` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:42.331548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=252aee53df604f5997b958ce157c4776)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:42.333545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:42.342564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1095/2187] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:42.342564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f4190-2028-451d-a7b3-bfa98adb223a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:42.342564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9d6f4190-2028-451d-a7b3-bfa98adb223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:42.374843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f4190-2028-451d-a7b3-bfa98adb223a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:42.385819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:42.386976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:42.387306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:42.387619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] PATH_INFO: `/v3/projects/dd1a33ba14a149dbae3efc1dfa98ffed` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:42.389091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1a33ba14a149dbae3efc1dfa98ffed)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:42.391292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:42.461460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252aee53df604f5997b958ce157c4776'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:42.476431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252aee53df604f5997b958ce157c4776'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:42.495883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252aee53df604f5997b958ce157c4776'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:42.497882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252aee53df604f5997b958ce157c4776'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:42.506103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1a33ba14a149dbae3efc1dfa98ffed', 'request_id': 'req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:42.516451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252aee53df604f5997b958ce157c4776'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:42.519389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1a33ba14a149dbae3efc1dfa98ffed', 'request_id': 'req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:42.519883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:42.542881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1a33ba14a149dbae3efc1dfa98ffed', 'request_id': 'req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:42.547667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1093/2188] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:41 2022] DELETE /identity/v3/users/252aee53df604f5997b958ce157c4776 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:42.556361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:42.561600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:42.605437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] The token cache is being invalidate because project dd1a33ba14a149dbae3efc1dfa98ffed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:42.605915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:42.610308 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6e9fee3-bccf-4d9a-a8cd-9315099ae5ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:42.624384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1096/2189] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:42 2022] DELETE /identity/v3/projects/dd1a33ba14a149dbae3efc1dfa98ffed => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:42.627763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf321b9-d364-41d4-a5dd-cf50d97c44a2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:42.628271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf321b9-d364-41d4-a5dd-cf50d97c44a2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:42.628781 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf321b9-d364-41d4-a5dd-cf50d97c44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:42.668022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bbf321b9-d364-41d4-a5dd-cf50d97c44a2 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:42.671383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bbf321b9-d364-41d4-a5dd-cf50d97c44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:42.783653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58920716-fefb-4a8f-a78b-c7fceffee13f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:42.800257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc470bc-90c4-4ed4-92a7-2e83a3db6fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:42.807270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc470bc-90c4-4ed4-92a7-2e83a3db6fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:42.807567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc470bc-90c4-4ed4-92a7-2e83a3db6fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:42.808132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc470bc-90c4-4ed4-92a7-2e83a3db6fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:42.809484 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc470bc-90c4-4ed4-92a7-2e83a3db6fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:42.813241 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc470bc-90c4-4ed4-92a7-2e83a3db6fb1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:42.893863 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1097/2190] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:42.900545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb224e0f-bd46-4d58-997f-3cf583817c60 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:42.900839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb224e0f-bd46-4d58-997f-3cf583817c60 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:42.901356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb224e0f-bd46-4d58-997f-3cf583817c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:42.919434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1094/2191] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:42 2022] POST /identity/v3/projects => generated 381 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:42.919434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc470bc-90c4-4ed4-92a7-2e83a3db6fb1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:42.922930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9bc470bc-90c4-4ed4-92a7-2e83a3db6fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:42.957238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-cb224e0f-bd46-4d58-997f-3cf583817c60 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:42.961283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cb224e0f-bd46-4d58-997f-3cf583817c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:43.113338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:43.136506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1098/2192] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:43.143634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb224e0f-bd46-4d58-997f-3cf583817c60 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:43.143634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cb224e0f-bd46-4d58-997f-3cf583817c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:43.183716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc470bc-90c4-4ed4-92a7-2e83a3db6fb1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:43.201547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:43.202475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.202790 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.203065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] PATH_INFO: `/v3/projects/4070b5c2390940358c5ad611364d60dc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.204991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4070b5c2390940358c5ad611364d60dc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:43.206978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:43.281009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4070b5c2390940358c5ad611364d60dc', 'request_id': 'req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:43.281663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb224e0f-bd46-4d58-997f-3cf583817c60 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:43.292856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4070b5c2390940358c5ad611364d60dc', 'request_id': 'req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:43.304286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4070b5c2390940358c5ad611364d60dc', 'request_id': 'req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:43.342066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] The token cache is being invalidate because project 4070b5c2390940358c5ad611364d60dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:43.342779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:43.344774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:43.349230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1095/2193] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:42 2022] DELETE /identity/v3/projects/4070b5c2390940358c5ad611364d60dc => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:43.352556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:43.355034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:43.375548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ed8b9-18a9-48e3-ae4d-59142fb5fc50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:43.376820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ed8b9-18a9-48e3-ae4d-59142fb5fc50 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.377365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ed8b9-18a9-48e3-ae4d-59142fb5fc50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.377949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ed8b9-18a9-48e3-ae4d-59142fb5fc50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.381250 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bc2ed8b9-18a9-48e3-ae4d-59142fb5fc50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:43.418790 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:43.501313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ec5d-71a5-4be7-ac77-fc18c3aaf3d2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:43.502112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ed8b9-18a9-48e3-ae4d-59142fb5fc50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:43.504178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ed8b9-18a9-48e3-ae4d-59142fb5fc50 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:43.507291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bde702-625d-4473-9f31-4cbebf52dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:43.508423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bde702-625d-4473-9f31-4cbebf52dbfe admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.508893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bde702-625d-4473-9f31-4cbebf52dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.509216 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bde702-625d-4473-9f31-4cbebf52dbfe admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.510021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bde702-625d-4473-9f31-4cbebf52dbfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:43.512507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bde702-625d-4473-9f31-4cbebf52dbfe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:43.527431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1099/2194] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:43.529955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc709-3a3c-4f8c-a15e-2fca7c73081e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.530660 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc709-3a3c-4f8c-a15e-2fca7c73081e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.531225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc709-3a3c-4f8c-a15e-2fca7c73081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.548559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1096/2195] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:43 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:43.548778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec0b2-a6a1-4ac2-a239-43862327aded None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.549208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec0b2-a6a1-4ac2-a239-43862327aded None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.549704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec0b2-a6a1-4ac2-a239-43862327aded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.564448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-62bcc709-3a3c-4f8c-a15e-2fca7c73081e None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:43.566656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-62bcc709-3a3c-4f8c-a15e-2fca7c73081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:43.585765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1100/2196] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:43.585765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcc709-3a3c-4f8c-a15e-2fca7c73081e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:43.588357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ea8ec0b2-a6a1-4ac2-a239-43862327aded None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:43.591197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ea8ec0b2-a6a1-4ac2-a239-43862327aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:43.614069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1097/2197] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:43.614069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ec0b2-a6a1-4ac2-a239-43862327aded None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:43.614409 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcc709-3a3c-4f8c-a15e-2fca7c73081e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:43.620422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abd25e-ad6d-43ac-aabd-dc02a4a10e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:43.621694 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abd25e-ad6d-43ac-aabd-dc02a4a10e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.622238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abd25e-ad6d-43ac-aabd-dc02a4a10e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.623083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abd25e-ad6d-43ac-aabd-dc02a4a10e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.623707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abd25e-ad6d-43ac-aabd-dc02a4a10e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:43.625462 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abd25e-ad6d-43ac-aabd-dc02a4a10e37 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:43.642886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ec0b2-a6a1-4ac2-a239-43862327aded None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:43.651302 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1101/2198] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:43.655679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485bf6f-dbaa-4b90-bf2a-e0b1d37884a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:43.655679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485bf6f-dbaa-4b90-bf2a-e0b1d37884a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.655679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485bf6f-dbaa-4b90-bf2a-e0b1d37884a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.655679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485bf6f-dbaa-4b90-bf2a-e0b1d37884a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.656052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485bf6f-dbaa-4b90-bf2a-e0b1d37884a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:43.656052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485bf6f-dbaa-4b90-bf2a-e0b1d37884a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:43.658380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485bf6f-dbaa-4b90-bf2a-e0b1d37884a8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:43.658651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d852c-f67a-486d-acc5-f084bd230be3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.659048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d852c-f67a-486d-acc5-f084bd230be3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.659540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d852c-f67a-486d-acc5-f084bd230be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.690191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1098/2199] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:43.690191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485bf6f-dbaa-4b90-bf2a-e0b1d37884a8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:43.693174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2e7d852c-f67a-486d-acc5-f084bd230be3 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:43.695680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2e7d852c-f67a-486d-acc5-f084bd230be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:43.711426 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1102/2200] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:43.714184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d852c-f67a-486d-acc5-f084bd230be3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:43.715712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485bf6f-dbaa-4b90-bf2a-e0b1d37884a8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:43.728904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa731ca0-6338-426b-87f8-fca3ec8e19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:43.730823 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa731ca0-6338-426b-87f8-fca3ec8e19de admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.731692 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa731ca0-6338-426b-87f8-fca3ec8e19de admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.732069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa731ca0-6338-426b-87f8-fca3ec8e19de admin admin] PATH_INFO: `/v3/projects/650af61155b54665ba3128b9d0f9c08d/users/74f318d8d48c453fa4f1298265b6aa6c/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.741824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d852c-f67a-486d-acc5-f084bd230be3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:43.758533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fc2ee-765a-445c-b0e7-d7884915d3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:43.760135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fc2ee-765a-445c-b0e7-d7884915d3ac admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.760824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fc2ee-765a-445c-b0e7-d7884915d3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.761836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fc2ee-765a-445c-b0e7-d7884915d3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.762850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fc2ee-765a-445c-b0e7-d7884915d3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:43.765874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fc2ee-765a-445c-b0e7-d7884915d3ac admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:43.767181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa731ca0-6338-426b-87f8-fca3ec8e19de admin admin] RBAC: Authorizing `identity:create_grant(project_id=650af61155b54665ba3128b9d0f9c08d, user_id=74f318d8d48c453fa4f1298265b6aa6c, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:43.773671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa731ca0-6338-426b-87f8-fca3ec8e19de admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:43.796422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1099/2201] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:43 2022] PUT /identity/v3/projects/650af61155b54665ba3128b9d0f9c08d/users/74f318d8d48c453fa4f1298265b6aa6c/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:43.798789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa731ca0-6338-426b-87f8-fca3ec8e19de admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:43.813017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1103/2202] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:43 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:43.815914 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fc2ee-765a-445c-b0e7-d7884915d3ac admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:43.842225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:43.918889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fc2ee-765a-445c-b0e7-d7884915d3ac admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:43.926659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fbb3-419e-44e7-bb79-ab4e793f34cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:43.927431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fbb3-419e-44e7-bb79-ab4e793f34cd admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.927729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fbb3-419e-44e7-bb79-ab4e793f34cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.928072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001fbb3-419e-44e7-bb79-ab4e793f34cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.931866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001fbb3-419e-44e7-bb79-ab4e793f34cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:43.947007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001fbb3-419e-44e7-bb79-ab4e793f34cd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:43.956144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa731ca0-6338-426b-87f8-fca3ec8e19de admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:43.961186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1104/2203] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:43.962194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fbb3-419e-44e7-bb79-ab4e793f34cd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:43.972921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb66a7-6e18-4a50-9e1a-876ee8dae7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:43.973835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001fbb3-419e-44e7-bb79-ab4e793f34cd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:43.975938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb66a7-6e18-4a50-9e1a-876ee8dae7cc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:43.976638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb66a7-6e18-4a50-9e1a-876ee8dae7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:43.977800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb66a7-6e18-4a50-9e1a-876ee8dae7cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:43.979880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb66a7-6e18-4a50-9e1a-876ee8dae7cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:43.980831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb66a7-6e18-4a50-9e1a-876ee8dae7cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:43.990842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb66a7-6e18-4a50-9e1a-876ee8dae7cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:43.995463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a61526-a206-4bda-bb48-d6b76ea0c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:43.999666 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a61526-a206-4bda-bb48-d6b76ea0c308 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:44.002636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a61526-a206-4bda-bb48-d6b76ea0c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:44.002636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a61526-a206-4bda-bb48-d6b76ea0c308 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:44.019392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a61526-a206-4bda-bb48-d6b76ea0c308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:44.025240 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a61526-a206-4bda-bb48-d6b76ea0c308 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:44.060998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1100/2204] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:44.060998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb66a7-6e18-4a50-9e1a-876ee8dae7cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:44.076491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1105/2205] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:43 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:44.079591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a61526-a206-4bda-bb48-d6b76ea0c308 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:44.094351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb66a7-6e18-4a50-9e1a-876ee8dae7cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:44.103955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a61526-a206-4bda-bb48-d6b76ea0c308 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:44.119358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a74552-e257-4e79-ab6a-885a6efc63b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:44.120062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd22e4-e10c-4639-adbc-fb24ce5c5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:44.120527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a74552-e257-4e79-ab6a-885a6efc63b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:44.121091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a74552-e257-4e79-ab6a-885a6efc63b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:44.121538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a74552-e257-4e79-ab6a-885a6efc63b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:44.126334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd22e4-e10c-4639-adbc-fb24ce5c5269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:44.127279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd22e4-e10c-4639-adbc-fb24ce5c5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:44.127654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd22e4-e10c-4639-adbc-fb24ce5c5269 admin admin] PATH_INFO: `/v3/projects/650af61155b54665ba3128b9d0f9c08d/users/74f318d8d48c453fa4f1298265b6aa6c/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:44.132076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a74552-e257-4e79-ab6a-885a6efc63b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:44.142054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a74552-e257-4e79-ab6a-885a6efc63b6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:44.144368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd22e4-e10c-4639-adbc-fb24ce5c5269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650af61155b54665ba3128b9d0f9c08d, user_id=74f318d8d48c453fa4f1298265b6aa6c, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:44.150967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd22e4-e10c-4639-adbc-fb24ce5c5269 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:44.208322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1101/2206] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:44 2022] PUT /identity/v3/projects/650af61155b54665ba3128b9d0f9c08d/users/74f318d8d48c453fa4f1298265b6aa6c/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:44.210088 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd22e4-e10c-4639-adbc-fb24ce5c5269 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:44.265224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1106/2207] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:44 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:44.284175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46f9aa-7604-4f80-b860-51c152713608 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:44.284719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46f9aa-7604-4f80-b860-51c152713608 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:44.285236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46f9aa-7604-4f80-b860-51c152713608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:44.399712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-af46f9aa-7604-4f80-b860-51c152713608 None None] MFA Rules not processed for user `74f318d8d48c453fa4f1298265b6aa6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:44.402987 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-af46f9aa-7604-4f80-b860-51c152713608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:44.425752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:44.514985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd22e4-e10c-4639-adbc-fb24ce5c5269 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:44.657098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1107/2208] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:44.658719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46f9aa-7604-4f80-b860-51c152713608 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:44.776932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe96159-4e5a-4cc6-8119-63fbfca31265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:44.778075 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe96159-4e5a-4cc6-8119-63fbfca31265 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:44.778589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe96159-4e5a-4cc6-8119-63fbfca31265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:44.779107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe96159-4e5a-4cc6-8119-63fbfca31265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:44.780571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe96159-4e5a-4cc6-8119-63fbfca31265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:44.792061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe96159-4e5a-4cc6-8119-63fbfca31265 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:44.826091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1102/2209] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 617 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:44.827739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe96159-4e5a-4cc6-8119-63fbfca31265 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:44.838294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4fe96159-4e5a-4cc6-8119-63fbfca31265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:44.842106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:44.847585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46f9aa-7604-4f80-b860-51c152713608 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:44.870818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120c0f8-cb3f-4443-bc78-72daeefd92d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:44.871619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120c0f8-cb3f-4443-bc78-72daeefd92d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:44.871911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120c0f8-cb3f-4443-bc78-72daeefd92d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:44.872193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120c0f8-cb3f-4443-bc78-72daeefd92d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:44.872928 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120c0f8-cb3f-4443-bc78-72daeefd92d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:44.875111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120c0f8-cb3f-4443-bc78-72daeefd92d1 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:44.898210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe96159-4e5a-4cc6-8119-63fbfca31265 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:44.915907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1108/2210] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:44 2022] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:44.915907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120c0f8-cb3f-4443-bc78-72daeefd92d1 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:44.916911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:44.919717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:44.919717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:44.920053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6120c0f8-cb3f-4443-bc78-72daeefd92d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:44.920959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] PATH_INFO: `/v3/projects/3abdbaf081a84754be1d6c4fe9b66be4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:44.923386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abdbaf081a84754be1d6c4fe9b66be4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:44.928642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:45.072913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abdbaf081a84754be1d6c4fe9b66be4', 'request_id': 'req-1ff43467-baed-4820-a935-41f71aac8bc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:45.093046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abdbaf081a84754be1d6c4fe9b66be4', 'request_id': 'req-1ff43467-baed-4820-a935-41f71aac8bc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:45.102358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abdbaf081a84754be1d6c4fe9b66be4', 'request_id': 'req-1ff43467-baed-4820-a935-41f71aac8bc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:45.122650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] The token cache is being invalidate because project 3abdbaf081a84754be1d6c4fe9b66be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:45.122986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:45.124092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:45.124668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120c0f8-cb3f-4443-bc78-72daeefd92d1 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:45.130201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1103/2211] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:44 2022] DELETE /identity/v3/projects/3abdbaf081a84754be1d6c4fe9b66be4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:45.132525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:45.136801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:45.232197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c702e2-7bdb-4128-b626-a0ca30e476c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:45.233458 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c702e2-7bdb-4128-b626-a0ca30e476c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:45.233458 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c702e2-7bdb-4128-b626-a0ca30e476c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:45.233659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c702e2-7bdb-4128-b626-a0ca30e476c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:45.237583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-49c702e2-7bdb-4128-b626-a0ca30e476c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:45.263884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff43467-baed-4820-a935-41f71aac8bc9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:45.270959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88e2d0-81bb-47d0-ad6b-4405cb563d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:45.271512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88e2d0-81bb-47d0-ad6b-4405cb563d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:45.272782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88e2d0-81bb-47d0-ad6b-4405cb563d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:45.272782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88e2d0-81bb-47d0-ad6b-4405cb563d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:45.273731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88e2d0-81bb-47d0-ad6b-4405cb563d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:45.279362 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88e2d0-81bb-47d0-ad6b-4405cb563d69 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:45.293645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1104/2212] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:45.294553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88e2d0-81bb-47d0-ad6b-4405cb563d69 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:45.296579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aa88e2d0-81bb-47d0-ad6b-4405cb563d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:45.310077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:45.315236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88e2d0-81bb-47d0-ad6b-4405cb563d69 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:45.331727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513db4a-dca2-46be-876c-33c856d08250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:45.331727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513db4a-dca2-46be-876c-33c856d08250 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:45.331727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513db4a-dca2-46be-876c-33c856d08250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:45.331727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513db4a-dca2-46be-876c-33c856d08250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:45.332190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513db4a-dca2-46be-876c-33c856d08250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:45.332190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513db4a-dca2-46be-876c-33c856d08250 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:45.346427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1105/2213] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:45.346427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513db4a-dca2-46be-876c-33c856d08250 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:45.346427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0513db4a-dca2-46be-876c-33c856d08250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:45.362800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513db4a-dca2-46be-876c-33c856d08250 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:45.369664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:45.370713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:45.371218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:45.371558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] PATH_INFO: `/v3/users/ba6c0e159ca74054b004816d7fad943c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:45.373219 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6c0e159ca74054b004816d7fad943c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:45.375698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:45.385508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c702e2-7bdb-4128-b626-a0ca30e476c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:45.387988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c702e2-7bdb-4128-b626-a0ca30e476c4 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:45.414760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1109/2214] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:45.415749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c702e2-7bdb-4128-b626-a0ca30e476c4 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:45.427816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c702e2-7bdb-4128-b626-a0ca30e476c4 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:45.433731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d7afe-9111-4521-8f85-15f7bbfa961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:45.434665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d7afe-9111-4521-8f85-15f7bbfa961b admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:45.435023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d7afe-9111-4521-8f85-15f7bbfa961b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:45.435358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d7afe-9111-4521-8f85-15f7bbfa961b admin admin] PATH_INFO: `/v3/projects/ac850ac986b648999ee18a4ad79033b4/users/e1b76ba52fe447a5bbf620076c9140f1/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:45.454730 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d7afe-9111-4521-8f85-15f7bbfa961b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac850ac986b648999ee18a4ad79033b4, user_id=e1b76ba52fe447a5bbf620076c9140f1, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:45.457676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d7afe-9111-4521-8f85-15f7bbfa961b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:45.477276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1110/2215] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:45 2022] PUT /identity/v3/projects/ac850ac986b648999ee18a4ad79033b4/users/e1b76ba52fe447a5bbf620076c9140f1/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:45.478585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d7afe-9111-4521-8f85-15f7bbfa961b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:45.485429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6c0e159ca74054b004816d7fad943c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:45.536486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:45.544005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6c0e159ca74054b004816d7fad943c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:45.566726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6c0e159ca74054b004816d7fad943c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:45.567746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6c0e159ca74054b004816d7fad943c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:45.586085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2047ce8d-9964-4cb3-846d-1a5c3300e5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6c0e159ca74054b004816d7fad943c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:45.603794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1106/2216] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:45 2022] DELETE /identity/v3/users/ba6c0e159ca74054b004816d7fad943c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:45.607917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237b2df-816a-4d80-8828-bd37bacf42bd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:45.608342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237b2df-816a-4d80-8828-bd37bacf42bd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:45.608637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237b2df-816a-4d80-8828-bd37bacf42bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:45.609707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d7afe-9111-4521-8f85-15f7bbfa961b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:45.637029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7237b2df-816a-4d80-8828-bd37bacf42bd None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:45.638191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7237b2df-816a-4d80-8828-bd37bacf42bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:45.775378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915fe25-7a5f-4ea7-877a-ce92137ef50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:45.778612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915fe25-7a5f-4ea7-877a-ce92137ef50a admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:45.778980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915fe25-7a5f-4ea7-877a-ce92137ef50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:45.779516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915fe25-7a5f-4ea7-877a-ce92137ef50a admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:45.780742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915fe25-7a5f-4ea7-877a-ce92137ef50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:45.783032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915fe25-7a5f-4ea7-877a-ce92137ef50a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:45.807867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1111/2217] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:45.812756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915fe25-7a5f-4ea7-877a-ce92137ef50a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:45.814228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1107/2218] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:45.821033 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f915fe25-7a5f-4ea7-877a-ce92137ef50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:45.830793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237b2df-816a-4d80-8828-bd37bacf42bd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:45.833453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7237b2df-816a-4d80-8828-bd37bacf42bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:45.847703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915fe25-7a5f-4ea7-877a-ce92137ef50a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:45.860243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516600b-6835-47f2-b7cf-a0774b6a8826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:45.865063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516600b-6835-47f2-b7cf-a0774b6a8826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:45.866227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516600b-6835-47f2-b7cf-a0774b6a8826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:45.866869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516600b-6835-47f2-b7cf-a0774b6a8826 admin admin] PATH_INFO: `/v3/projects/61b480d0914c41b5b9e0af744ad10f13/users/12e306c49ff04f77bc587220a29338c9/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:45.908373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516600b-6835-47f2-b7cf-a0774b6a8826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b480d0914c41b5b9e0af744ad10f13, user_id=12e306c49ff04f77bc587220a29338c9, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:45.911943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516600b-6835-47f2-b7cf-a0774b6a8826 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:45.968446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1112/2219] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:45 2022] PUT /identity/v3/projects/61b480d0914c41b5b9e0af744ad10f13/users/12e306c49ff04f77bc587220a29338c9/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:45.970252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c7155-d244-4be8-854c-0ca6bf96883b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:45.972453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c7155-d244-4be8-854c-0ca6bf96883b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:45.972453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c7155-d244-4be8-854c-0ca6bf96883b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:46.022876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237b2df-816a-4d80-8828-bd37bacf42bd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:46.027761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-835c7155-d244-4be8-854c-0ca6bf96883b None None] MFA Rules not processed for user `12e306c49ff04f77bc587220a29338c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:46.030982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-835c7155-d244-4be8-854c-0ca6bf96883b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:46.073905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:46.235600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb02de-baae-4b54-931d-12fdeaacad89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:46.236517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb02de-baae-4b54-931d-12fdeaacad89 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:46.237946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb02de-baae-4b54-931d-12fdeaacad89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:46.238238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb02de-baae-4b54-931d-12fdeaacad89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:46.360506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1113/2220] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:46.362907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c7155-d244-4be8-854c-0ca6bf96883b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:46.367559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-835c7155-d244-4be8-854c-0ca6bf96883b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:46.480985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:46.510130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb02de-baae-4b54-931d-12fdeaacad89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:46.512613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb02de-baae-4b54-931d-12fdeaacad89 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:46.520680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c7155-d244-4be8-854c-0ca6bf96883b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:46.530370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b0a97-1046-435f-9b86-6ac82cddb5b5 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74f318d8d48c453fa4f1298265b6aa6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '650af61155b54665ba3128b9d0f9c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:46.530574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b0a97-1046-435f-9b86-6ac82cddb5b5 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:46.530774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b0a97-1046-435f-9b86-6ac82cddb5b5 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:46.531051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b0a97-1046-435f-9b86-6ac82cddb5b5 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:46.532360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b0a97-1046-435f-9b86-6ac82cddb5b5 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:46.532587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b0a97-1046-435f-9b86-6ac82cddb5b5 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:46.534168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b0a97-1046-435f-9b86-6ac82cddb5b5 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:46.545601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1108/2221] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:46.547294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb02de-baae-4b54-931d-12fdeaacad89 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:46.550999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1114/2222] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:46.564120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b0a97-1046-435f-9b86-6ac82cddb5b5 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:46.578017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b0a97-1046-435f-9b86-6ac82cddb5b5 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:46.591478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bd06f-bf9f-4117-92f9-b8d1a925eae9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74f318d8d48c453fa4f1298265b6aa6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '650af61155b54665ba3128b9d0f9c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:46.592201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bd06f-bf9f-4117-92f9-b8d1a925eae9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:46.592501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bd06f-bf9f-4117-92f9-b8d1a925eae9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:46.592793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bd06f-bf9f-4117-92f9-b8d1a925eae9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:46.593539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bd06f-bf9f-4117-92f9-b8d1a925eae9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:46.596549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bd06f-bf9f-4117-92f9-b8d1a925eae9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:46.598333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb02de-baae-4b54-931d-12fdeaacad89 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:46.625123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713453b5-97e0-49b7-9365-401f77140027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:46.625856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713453b5-97e0-49b7-9365-401f77140027 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:46.626147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713453b5-97e0-49b7-9365-401f77140027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:46.626483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713453b5-97e0-49b7-9365-401f77140027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:46.627202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713453b5-97e0-49b7-9365-401f77140027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:46.629281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713453b5-97e0-49b7-9365-401f77140027 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:46.641174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1115/2223] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:46 2022] POST /identity/v3/projects => generated 355 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:00:46.644628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bd06f-bf9f-4117-92f9-b8d1a925eae9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:46.720702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1109/2224] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:46 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:46.724060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713453b5-97e0-49b7-9365-401f77140027 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:46.878076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bd06f-bf9f-4117-92f9-b8d1a925eae9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:46.966418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713453b5-97e0-49b7-9365-401f77140027 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:46.979499 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8683da4-204a-466a-9003-e71c6ec424d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:46.981383 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8683da4-204a-466a-9003-e71c6ec424d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:46.982157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8683da4-204a-466a-9003-e71c6ec424d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:46.983048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8683da4-204a-466a-9003-e71c6ec424d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:46.985827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8683da4-204a-466a-9003-e71c6ec424d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:46.992472 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8683da4-204a-466a-9003-e71c6ec424d4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:46.993615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73651dae-9510-41a3-8e1d-776a58d9d563 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74f318d8d48c453fa4f1298265b6aa6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '650af61155b54665ba3128b9d0f9c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:46.994444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73651dae-9510-41a3-8e1d-776a58d9d563 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:46.994755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73651dae-9510-41a3-8e1d-776a58d9d563 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:46.995319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73651dae-9510-41a3-8e1d-776a58d9d563 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:46.999294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73651dae-9510-41a3-8e1d-776a58d9d563 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:46.999294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73651dae-9510-41a3-8e1d-776a58d9d563 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:47.001270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73651dae-9510-41a3-8e1d-776a58d9d563 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:47.029796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1116/2225] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:47.074199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1110/2226] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:46 2022] POST /identity/v3/users => generated 289 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:47.079292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73651dae-9510-41a3-8e1d-776a58d9d563 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:47.131586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73651dae-9510-41a3-8e1d-776a58d9d563 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:47.153971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b37ab-36cd-45d0-90ad-37afcb59302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:47.155123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b37ab-36cd-45d0-90ad-37afcb59302f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:47.155632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b37ab-36cd-45d0-90ad-37afcb59302f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:47.156143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b37ab-36cd-45d0-90ad-37afcb59302f admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:47.165441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b37ab-36cd-45d0-90ad-37afcb59302f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:47.168471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8683da4-204a-466a-9003-e71c6ec424d4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:47.187201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b37ab-36cd-45d0-90ad-37afcb59302f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:47.219224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8683da4-204a-466a-9003-e71c6ec424d4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:47.224571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1117/2227] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:00:47.226950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b37ab-36cd-45d0-90ad-37afcb59302f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:47.232445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74f318d8d48c453fa4f1298265b6aa6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '650af61155b54665ba3128b9d0f9c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:47.233377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:47.233669 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:47.233959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] PATH_INFO: `/v3/projects/09036b25ea624261a274e891fbd67442` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:47.241143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09036b25ea624261a274e891fbd67442)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:47.242734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:47.249995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b37ab-36cd-45d0-90ad-37afcb59302f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:47.263352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e13018-5df0-4283-8aec-4d6d99d8ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:47.266182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13018-5df0-4283-8aec-4d6d99d8ad68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:47.266445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13018-5df0-4283-8aec-4d6d99d8ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:47.266865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13018-5df0-4283-8aec-4d6d99d8ad68 admin admin] PATH_INFO: `/v3/projects/fa196597617943ee8ffa775efb377b1b/users/781e302b19c044fa8bb7c6e686428bc9/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:47.327899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e13018-5df0-4283-8aec-4d6d99d8ad68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa196597617943ee8ffa775efb377b1b, user_id=781e302b19c044fa8bb7c6e686428bc9, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:47.333404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e13018-5df0-4283-8aec-4d6d99d8ad68 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:47.367930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:47.370836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1118/2228] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:47 2022] PUT /identity/v3/projects/fa196597617943ee8ffa775efb377b1b/users/781e302b19c044fa8bb7c6e686428bc9/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:47.375129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e13018-5df0-4283-8aec-4d6d99d8ad68 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:47.392913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09036b25ea624261a274e891fbd67442', 'request_id': 'req-268224f5-d5b2-4b38-9291-5c66cf6719c9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:47.419051 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09036b25ea624261a274e891fbd67442', 'request_id': 'req-268224f5-d5b2-4b38-9291-5c66cf6719c9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:47.425473 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:47.451777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09036b25ea624261a274e891fbd67442', 'request_id': 'req-268224f5-d5b2-4b38-9291-5c66cf6719c9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:47.497060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e13018-5df0-4283-8aec-4d6d99d8ad68 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:47.548293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] The token cache is being invalidate because project 09036b25ea624261a274e891fbd67442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:47.551972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:47.556220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:47.563729 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1111/2229] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:47 2022] DELETE /identity/v3/projects/09036b25ea624261a274e891fbd67442 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:47.592242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798fef0-2ed2-4164-b767-7a9d6d03e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:47.593726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798fef0-2ed2-4164-b767-7a9d6d03e159 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:47.594252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798fef0-2ed2-4164-b767-7a9d6d03e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:47.594721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798fef0-2ed2-4164-b767-7a9d6d03e159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:47.595843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798fef0-2ed2-4164-b767-7a9d6d03e159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:47.598011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798fef0-2ed2-4164-b767-7a9d6d03e159 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:47.613790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1119/2230] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:47.620087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:47.622530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:47.651863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268224f5-d5b2-4b38-9291-5c66cf6719c9 tempest-VolumeQuotaClassesTest-2084087829 tempest-VolumeQuotaClassesTest-2084087829-project-admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:47.661436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea9e3a-734a-4f4f-b2ea-cfff66bd0ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:47.663619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9e3a-734a-4f4f-b2ea-cfff66bd0ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:47.664996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9e3a-734a-4f4f-b2ea-cfff66bd0ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:47.665563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9e3a-734a-4f4f-b2ea-cfff66bd0ef3 admin admin] PATH_INFO: `/v3/projects/fa196597617943ee8ffa775efb377b1b/users/781e302b19c044fa8bb7c6e686428bc9/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:47.670775 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea9e3a-734a-4f4f-b2ea-cfff66bd0ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa196597617943ee8ffa775efb377b1b, user_id=781e302b19c044fa8bb7c6e686428bc9, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:47.677189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea9e3a-734a-4f4f-b2ea-cfff66bd0ef3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:47.719884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1112/2231] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:47 2022] PUT /identity/v3/projects/fa196597617943ee8ffa775efb377b1b/users/781e302b19c044fa8bb7c6e686428bc9/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:47.723078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39005a-d4cd-42c3-8ef9-e895ccc5a803 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:47.723456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39005a-d4cd-42c3-8ef9-e895ccc5a803 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:47.723691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39005a-d4cd-42c3-8ef9-e895ccc5a803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:47.775379 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fb39005a-d4cd-42c3-8ef9-e895ccc5a803 None None] MFA Rules not processed for user `781e302b19c044fa8bb7c6e686428bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:47.777515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fb39005a-d4cd-42c3-8ef9-e895ccc5a803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:47.798311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea9e3a-734a-4f4f-b2ea-cfff66bd0ef3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:47.801464 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41ea9e3a-734a-4f4f-b2ea-cfff66bd0ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:47.972182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1120/2232] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:47.994441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39005a-d4cd-42c3-8ef9-e895ccc5a803 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:47.997091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fb39005a-d4cd-42c3-8ef9-e895ccc5a803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:48.047432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea9e3a-734a-4f4f-b2ea-cfff66bd0ef3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:48.062174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:48.066707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:48.067366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:48.068001 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] PATH_INFO: `/v3/projects/0fcf0cf43d9f4d469f20cf5341f64fc9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:48.072448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fcf0cf43d9f4d469f20cf5341f64fc9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:48.079027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:48.139136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:48.177634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39005a-d4cd-42c3-8ef9-e895ccc5a803 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:48.189466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fcf0cf43d9f4d469f20cf5341f64fc9', 'request_id': 'req-ac239d8a-3e87-4312-970d-8bd800cbecd7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.206558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fcf0cf43d9f4d469f20cf5341f64fc9', 'request_id': 'req-ac239d8a-3e87-4312-970d-8bd800cbecd7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.232826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fcf0cf43d9f4d469f20cf5341f64fc9', 'request_id': 'req-ac239d8a-3e87-4312-970d-8bd800cbecd7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.293724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] The token cache is being invalidate because project 0fcf0cf43d9f4d469f20cf5341f64fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:48.294340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.295608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.301456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1113/2233] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:47 2022] DELETE /identity/v3/projects/0fcf0cf43d9f4d469f20cf5341f64fc9 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:48.301456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:48.303864 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:48.338571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3736ea7-34d2-430a-836b-8ce1dd4531f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:48.339880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3736ea7-34d2-430a-836b-8ce1dd4531f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:48.340542 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3736ea7-34d2-430a-836b-8ce1dd4531f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:48.341115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3736ea7-34d2-430a-836b-8ce1dd4531f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:48.344725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c3736ea7-34d2-430a-836b-8ce1dd4531f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:48.477646 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:48.589677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac239d8a-3e87-4312-970d-8bd800cbecd7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:48.624357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:48.625943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:48.626458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:48.627399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] PATH_INFO: `/v3/users/d495c8dc1fd24347a82836774ad0509b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:48.638807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d495c8dc1fd24347a82836774ad0509b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:48.643283 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:48.644735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3736ea7-34d2-430a-836b-8ce1dd4531f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:48.648618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3736ea7-34d2-430a-836b-8ce1dd4531f0 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:48.689158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1121/2234] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:48.691270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3736ea7-34d2-430a-836b-8ce1dd4531f0 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:48.702198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c3736ea7-34d2-430a-836b-8ce1dd4531f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:48.742919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3736ea7-34d2-430a-836b-8ce1dd4531f0 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:48.761520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:48.764893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:48.765302 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:48.765888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] PATH_INFO: `/v3/users/d51a08991b514431a9201c030d410f69` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:48.769470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51a08991b514431a9201c030d410f69)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:48.774969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:48.896337 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd495c8dc1fd24347a82836774ad0509b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.935193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd495c8dc1fd24347a82836774ad0509b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.958896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd495c8dc1fd24347a82836774ad0509b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.970527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd495c8dc1fd24347a82836774ad0509b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.986374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd495c8dc1fd24347a82836774ad0509b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.990354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51a08991b514431a9201c030d410f69'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:48.998404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1114/2235] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:48 2022] DELETE /identity/v3/users/d495c8dc1fd24347a82836774ad0509b => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:49.000433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:49.003934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:49.015737 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51a08991b514431a9201c030d410f69'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:49.017132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51a08991b514431a9201c030d410f69'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:49.032921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51a08991b514431a9201c030d410f69'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:49.034057 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f47c2408-9654-4424-bd34-646ec4282cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51a08991b514431a9201c030d410f69'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:49.057172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1122/2236] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:48 2022] DELETE /identity/v3/users/d51a08991b514431a9201c030d410f69 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:49.059846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4605bf-503a-4580-8c66-63a727bb6aa5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:49.060249 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4605bf-503a-4580-8c66-63a727bb6aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:49.060501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4605bf-503a-4580-8c66-63a727bb6aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:49.094187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2d4605bf-503a-4580-8c66-63a727bb6aa5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:49.097414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2d4605bf-503a-4580-8c66-63a727bb6aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:49.126986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aad3a5-c660-4e31-8e26-01c181a98782 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:49.131712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:49.270333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1123/2237] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:49.306678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4605bf-503a-4580-8c66-63a727bb6aa5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:49.309276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2d4605bf-503a-4580-8c66-63a727bb6aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:49.314513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865fbe4-3da9-486f-836b-9289d58d527a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:49.316635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865fbe4-3da9-486f-836b-9289d58d527a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:49.317536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865fbe4-3da9-486f-836b-9289d58d527a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:49.321981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865fbe4-3da9-486f-836b-9289d58d527a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:49.327767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b865fbe4-3da9-486f-836b-9289d58d527a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:49.407660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:49.463939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4605bf-503a-4580-8c66-63a727bb6aa5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:49.467873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865fbe4-3da9-486f-836b-9289d58d527a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:49.468171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4380bd6-b051-4045-8c35-d2553c7fc91c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:49.469028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4380bd6-b051-4045-8c35-d2553c7fc91c service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:49.469329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4380bd6-b051-4045-8c35-d2553c7fc91c service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:49.469611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4380bd6-b051-4045-8c35-d2553c7fc91c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:49.472363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865fbe4-3da9-486f-836b-9289d58d527a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:49.486901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4380bd6-b051-4045-8c35-d2553c7fc91c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:49.488688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4380bd6-b051-4045-8c35-d2553c7fc91c service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:49.497321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1115/2238] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:49.513363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1124/2239] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:49.688039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865fbe4-3da9-486f-836b-9289d58d527a service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:49.690747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b865fbe4-3da9-486f-836b-9289d58d527a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:49.749606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865fbe4-3da9-486f-836b-9289d58d527a service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:49.778937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:49.780549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:49.780973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:49.786613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] PATH_INFO: `/v3/projects/351596e7c3544106bfdfa6fdab01d741` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:49.794657 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=351596e7c3544106bfdfa6fdab01d741)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:49.804433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:49.977901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351596e7c3544106bfdfa6fdab01d741', 'request_id': 'req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:49.988186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351596e7c3544106bfdfa6fdab01d741', 'request_id': 'req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:50.000945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351596e7c3544106bfdfa6fdab01d741', 'request_id': 'req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:50.027757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] The token cache is being invalidate because project 351596e7c3544106bfdfa6fdab01d741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:50.029065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:50.032335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ce1d977-013a-4f51-9cf8-a15cf3e121ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:50.059554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1116/2240] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:49 2022] DELETE /identity/v3/projects/351596e7c3544106bfdfa6fdab01d741 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:50.069439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ce7a-9c78-4ec7-a933-a063a19fcc39 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:50.070193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ce7a-9c78-4ec7-a933-a063a19fcc39 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:50.070591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ce7a-9c78-4ec7-a933-a063a19fcc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:50.152506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-97c0ce7a-9c78-4ec7-a933-a063a19fcc39 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:50.154625 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-97c0ce7a-9c78-4ec7-a933-a063a19fcc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:50.420191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64653f87-f400-43ca-8058-d39d03d19d5b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:50.420889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64653f87-f400-43ca-8058-d39d03d19d5b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:50.421401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64653f87-f400-43ca-8058-d39d03d19d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:50.423208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1125/2241] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:00:50.458262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-64653f87-f400-43ca-8058-d39d03d19d5b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:50.462339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-64653f87-f400-43ca-8058-d39d03d19d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:50.472984 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1117/2242] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:00:50.477749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ce7a-9c78-4ec7-a933-a063a19fcc39 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:50.493944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ce7a-9c78-4ec7-a933-a063a19fcc39 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:50.499909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8c32c-117a-472f-beee-cc2b6152daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:50.501592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8c32c-117a-472f-beee-cc2b6152daf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:50.502116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8c32c-117a-472f-beee-cc2b6152daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:50.502414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8c32c-117a-472f-beee-cc2b6152daf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:50.503474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8c32c-117a-472f-beee-cc2b6152daf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:50.503854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8c32c-117a-472f-beee-cc2b6152daf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:50.505807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8c32c-117a-472f-beee-cc2b6152daf0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:50.537181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1126/2243] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:50.537950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64653f87-f400-43ca-8058-d39d03d19d5b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:50.555011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64653f87-f400-43ca-8058-d39d03d19d5b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:50.562561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43c9a3-6303-4092-b2f9-452451232508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:50.563943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43c9a3-6303-4092-b2f9-452451232508 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:50.564228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43c9a3-6303-4092-b2f9-452451232508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:50.564721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43c9a3-6303-4092-b2f9-452451232508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:50.565487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43c9a3-6303-4092-b2f9-452451232508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:50.567797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43c9a3-6303-4092-b2f9-452451232508 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:50.627569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1118/2244] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:50 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:00:50.635533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8c32c-117a-472f-beee-cc2b6152daf0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:50.664118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8c32c-117a-472f-beee-cc2b6152daf0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:50.754203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:50.774040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae143b9-9815-479c-9f9a-d27e16e9f1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:50.776026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae143b9-9815-479c-9f9a-d27e16e9f1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:50.776026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae143b9-9815-479c-9f9a-d27e16e9f1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:50.776437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae143b9-9815-479c-9f9a-d27e16e9f1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:50.777604 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae143b9-9815-479c-9f9a-d27e16e9f1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:50.781782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae143b9-9815-479c-9f9a-d27e16e9f1d5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:50.830165 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1127/2245] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:50 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:50.832382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43c9a3-6303-4092-b2f9-452451232508 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:50.858183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43c9a3-6303-4092-b2f9-452451232508 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:50.867713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d280584-c202-4761-90c5-157c9451d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:50.868690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280584-c202-4761-90c5-157c9451d632 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:50.869270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280584-c202-4761-90c5-157c9451d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:50.869654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280584-c202-4761-90c5-157c9451d632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:50.870660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d280584-c202-4761-90c5-157c9451d632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:50.873187 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d280584-c202-4761-90c5-157c9451d632 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:50.889756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1119/2246] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:50.895197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae143b9-9815-479c-9f9a-d27e16e9f1d5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:50.917613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae143b9-9815-479c-9f9a-d27e16e9f1d5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:50.926959 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25680bd9-fa6e-4bbf-9185-dc51b10f4bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:50.927494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25680bd9-fa6e-4bbf-9185-dc51b10f4bae admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:50.927494 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25680bd9-fa6e-4bbf-9185-dc51b10f4bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:50.928423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25680bd9-fa6e-4bbf-9185-dc51b10f4bae admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:50.928746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25680bd9-fa6e-4bbf-9185-dc51b10f4bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:50.930428 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25680bd9-fa6e-4bbf-9185-dc51b10f4bae admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:50.945024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1128/2247] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:50.951735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d280584-c202-4761-90c5-157c9451d632 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:50.986833 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d280584-c202-4761-90c5-157c9451d632 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:51.005962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4d38-23f2-42b8-9588-babeeb6553ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:51.007260 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4d38-23f2-42b8-9588-babeeb6553ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:51.009581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4d38-23f2-42b8-9588-babeeb6553ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:51.010071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4d38-23f2-42b8-9588-babeeb6553ee admin admin] PATH_INFO: `/v3/projects/ad4cb990658540208e071abdf3e3cf28/users/c40b6e375eca4ce087074b6045913e82/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:51.062135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc4d38-23f2-42b8-9588-babeeb6553ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4cb990658540208e071abdf3e3cf28, user_id=c40b6e375eca4ce087074b6045913e82, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:51.065291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc4d38-23f2-42b8-9588-babeeb6553ee admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:51.102812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1120/2248] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:50 2022] PUT /identity/v3/projects/ad4cb990658540208e071abdf3e3cf28/users/c40b6e375eca4ce087074b6045913e82/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:51.117188 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a254-27ca-47e5-8cb0-13adaf94f812 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:51.117991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a254-27ca-47e5-8cb0-13adaf94f812 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:51.117991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a254-27ca-47e5-8cb0-13adaf94f812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:51.181176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0053a254-27ca-47e5-8cb0-13adaf94f812 None None] MFA Rules not processed for user `c40b6e375eca4ce087074b6045913e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:51.184005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0053a254-27ca-47e5-8cb0-13adaf94f812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:51.203377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d917d-9ffc-4998-865b-731f95d9e4d0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:51.204511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d917d-9ffc-4998-865b-731f95d9e4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:51.205342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d917d-9ffc-4998-865b-731f95d9e4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:51.376700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f59d917d-9ffc-4998-865b-731f95d9e4d0 None None] MFA Rules not processed for user `e1b76ba52fe447a5bbf620076c9140f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:51.381946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f59d917d-9ffc-4998-865b-731f95d9e4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:51.478375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1129/2249] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:51.497053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a254-27ca-47e5-8cb0-13adaf94f812 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:51.500995 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0053a254-27ca-47e5-8cb0-13adaf94f812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:51.560045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:51.636213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1121/2250] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:51.637438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d917d-9ffc-4998-865b-731f95d9e4d0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:51.640877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f59d917d-9ffc-4998-865b-731f95d9e4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:51.788914 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a254-27ca-47e5-8cb0-13adaf94f812 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:51.806462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d917d-9ffc-4998-865b-731f95d9e4d0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:51.814748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:51.816249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:51.816977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:51.817805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc407c-77e6-426c-afcf-f38b9489df38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61565364dbac41cfac76195c0be88771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:51.818166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] PATH_INFO: `/v3/projects/f88dab3194c04e7abfa792fd5825ce8f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:51.820249 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc407c-77e6-426c-afcf-f38b9489df38 service glance] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:51.821631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc407c-77e6-426c-afcf-f38b9489df38 service glance] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:51.824247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc407c-77e6-426c-afcf-f38b9489df38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:51.834822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f88dab3194c04e7abfa792fd5825ce8f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:51.840323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:51.862273 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc407c-77e6-426c-afcf-f38b9489df38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:51.871861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc407c-77e6-426c-afcf-f38b9489df38 service glance] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:51.918891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1130/2251] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:51.963970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f88dab3194c04e7abfa792fd5825ce8f', 'request_id': 'req-76fad8f6-b737-4b8e-b4af-1f1521852fca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:51.974414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f88dab3194c04e7abfa792fd5825ce8f', 'request_id': 'req-76fad8f6-b737-4b8e-b4af-1f1521852fca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:52.000150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f88dab3194c04e7abfa792fd5825ce8f', 'request_id': 'req-76fad8f6-b737-4b8e-b4af-1f1521852fca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:52.057567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] The token cache is being invalidate because project f88dab3194c04e7abfa792fd5825ce8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:52.060517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:52.070645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:52.074468 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1122/2252] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:51 2022] DELETE /identity/v3/projects/f88dab3194c04e7abfa792fd5825ce8f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:52.083324 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc407c-77e6-426c-afcf-f38b9489df38 service glance] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:52.119228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc407c-77e6-426c-afcf-f38b9489df38 service glance] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:52.235914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:52.238488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:52.402650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:52.410774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:52.411563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:52.413370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] PATH_INFO: `/v3/users/74f318d8d48c453fa4f1298265b6aa6c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:52.418125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f318d8d48c453fa4f1298265b6aa6c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:52.428689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:52.443994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:52.539408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:52.548811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fad8f6-b737-4b8e-b4af-1f1521852fca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:52.566409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b18ad-b3a5-45a7-9167-455f8287a520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:52.567622 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b18ad-b3a5-45a7-9167-455f8287a520 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:52.569035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b18ad-b3a5-45a7-9167-455f8287a520 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:52.575954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b18ad-b3a5-45a7-9167-455f8287a520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:52.582139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e31b18ad-b3a5-45a7-9167-455f8287a520 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:52.603189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f318d8d48c453fa4f1298265b6aa6c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:52.648434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f318d8d48c453fa4f1298265b6aa6c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:52.649851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f318d8d48c453fa4f1298265b6aa6c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:52.670096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f318d8d48c453fa4f1298265b6aa6c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:52.671750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f318d8d48c453fa4f1298265b6aa6c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:52.729801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1131/2253] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:52 2022] DELETE /identity/v3/users/74f318d8d48c453fa4f1298265b6aa6c => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:52.864190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b18ad-b3a5-45a7-9167-455f8287a520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:52.867307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b18ad-b3a5-45a7-9167-455f8287a520 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:52.906493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1123/2254] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:00:53.340810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:53.347756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:53.747525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc802c50-1a87-44fb-b170-bd47b018db10 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:53.750321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:53.762567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:53.762567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:53.762567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] PATH_INFO: `/v3/projects/650af61155b54665ba3128b9d0f9c08d` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:53.762567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650af61155b54665ba3128b9d0f9c08d)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:53.769295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:53.938120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650af61155b54665ba3128b9d0f9c08d', 'request_id': 'req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:53.951473 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650af61155b54665ba3128b9d0f9c08d', 'request_id': 'req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:53.977393 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650af61155b54665ba3128b9d0f9c08d', 'request_id': 'req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:53.992992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] The token cache is being invalidate because project 650af61155b54665ba3128b9d0f9c08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:53.993286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:53.994481 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a89ae2e9-f3b8-4dea-9bba-17f932b49c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:53.996848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1132/2255] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:53 2022] DELETE /identity/v3/projects/650af61155b54665ba3128b9d0f9c08d => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:00:54.011314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958602c-88b3-42b5-ac19-3fb102700d4d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:54.011975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958602c-88b3-42b5-ac19-3fb102700d4d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:54.012328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958602c-88b3-42b5-ac19-3fb102700d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:54.093162 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3958602c-88b3-42b5-ac19-3fb102700d4d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:54.095358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3958602c-88b3-42b5-ac19-3fb102700d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:54.291248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1124/2256] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:54.304369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7999d-fb88-45a0-a859-6392ebafb815 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:54.304690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7999d-fb88-45a0-a859-6392ebafb815 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:54.304949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7999d-fb88-45a0-a859-6392ebafb815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:54.360950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fbf7999d-fb88-45a0-a859-6392ebafb815 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:54.370094 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fbf7999d-fb88-45a0-a859-6392ebafb815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:54.393900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1133/2257] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:54.400375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958602c-88b3-42b5-ac19-3fb102700d4d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:54.414846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958602c-88b3-42b5-ac19-3fb102700d4d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:54.427138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207af3a-acb9-4614-b6e6-9c2aa3c48bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:54.429008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207af3a-acb9-4614-b6e6-9c2aa3c48bef admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:54.429473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207af3a-acb9-4614-b6e6-9c2aa3c48bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:54.429926 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207af3a-acb9-4614-b6e6-9c2aa3c48bef admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:54.431686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207af3a-acb9-4614-b6e6-9c2aa3c48bef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:54.432234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207af3a-acb9-4614-b6e6-9c2aa3c48bef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:54.434078 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207af3a-acb9-4614-b6e6-9c2aa3c48bef admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:54.450596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1125/2258] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:54.457316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7999d-fb88-45a0-a859-6392ebafb815 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:54.472571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7999d-fb88-45a0-a859-6392ebafb815 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:54.478890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a2c18-d22d-4644-8b66-e81e4cf5ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:54.479931 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2c18-d22d-4644-8b66-e81e4cf5ddbf admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:54.480409 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2c18-d22d-4644-8b66-e81e4cf5ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:54.480871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a2c18-d22d-4644-8b66-e81e4cf5ddbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:54.481813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a2c18-d22d-4644-8b66-e81e4cf5ddbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:54.483906 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a2c18-d22d-4644-8b66-e81e4cf5ddbf admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:54.500103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:54.573635 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1134/2259] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:54 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:54.579865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207af3a-acb9-4614-b6e6-9c2aa3c48bef admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:54.595495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207af3a-acb9-4614-b6e6-9c2aa3c48bef admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:54.766168 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551c321-d0da-41ce-ac91-89af6799a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:54.768121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551c321-d0da-41ce-ac91-89af6799a5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:54.768724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551c321-d0da-41ce-ac91-89af6799a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:54.769487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551c321-d0da-41ce-ac91-89af6799a5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:54.771024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551c321-d0da-41ce-ac91-89af6799a5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:54.776657 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551c321-d0da-41ce-ac91-89af6799a5c6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:54.870079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1126/2260] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:54 2022] POST /identity/v3/users => generated 295 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:00:54.872835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a2c18-d22d-4644-8b66-e81e4cf5ddbf admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:54.904018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a2c18-d22d-4644-8b66-e81e4cf5ddbf admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:54.941139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944860d1-1db2-463d-ae55-d14ed2818c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:54.947894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944860d1-1db2-463d-ae55-d14ed2818c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:54.949805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944860d1-1db2-463d-ae55-d14ed2818c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:54.951336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944860d1-1db2-463d-ae55-d14ed2818c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:54.956216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944860d1-1db2-463d-ae55-d14ed2818c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:54.965702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944860d1-1db2-463d-ae55-d14ed2818c24 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:55.055693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1135/2261] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:00:55.060147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551c321-d0da-41ce-ac91-89af6799a5c6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:55.085609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551c321-d0da-41ce-ac91-89af6799a5c6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:55.112831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daddc55-8518-4f4d-bfba-84e874326d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:55.113992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daddc55-8518-4f4d-bfba-84e874326d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:55.116153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daddc55-8518-4f4d-bfba-84e874326d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:55.116757 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daddc55-8518-4f4d-bfba-84e874326d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:55.118742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daddc55-8518-4f4d-bfba-84e874326d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:55.122775 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daddc55-8518-4f4d-bfba-84e874326d2c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:55.150808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1127/2262] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:55.164809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944860d1-1db2-463d-ae55-d14ed2818c24 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:55.207383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944860d1-1db2-463d-ae55-d14ed2818c24 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:55.229250 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312df77-4357-4197-a474-ea9528cb0f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:55.231553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312df77-4357-4197-a474-ea9528cb0f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:55.232562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312df77-4357-4197-a474-ea9528cb0f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:55.233237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312df77-4357-4197-a474-ea9528cb0f1e admin admin] PATH_INFO: `/v3/projects/b9a47c81a55e45a785d2925ec4fe239c/users/e6526316996d4b8ea5034082d5a052b2/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:55.282719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312df77-4357-4197-a474-ea9528cb0f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a47c81a55e45a785d2925ec4fe239c, user_id=e6526316996d4b8ea5034082d5a052b2, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:55.289058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312df77-4357-4197-a474-ea9528cb0f1e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:55.335316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1136/2263] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:55 2022] PUT /identity/v3/projects/b9a47c81a55e45a785d2925ec4fe239c/users/e6526316996d4b8ea5034082d5a052b2/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:55.348745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140a14-4f97-43fa-b642-a109db0a519e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:55.349066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140a14-4f97-43fa-b642-a109db0a519e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:55.350896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65140a14-4f97-43fa-b642-a109db0a519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:55.382382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:55.418544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-65140a14-4f97-43fa-b642-a109db0a519e None None] MFA Rules not processed for user `e6526316996d4b8ea5034082d5a052b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:55.420665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65140a14-4f97-43fa-b642-a109db0a519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:55.704609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1128/2264] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:55.713790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312df77-4357-4197-a474-ea9528cb0f1e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:55.853361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140a14-4f97-43fa-b642-a109db0a519e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:55.856408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65140a14-4f97-43fa-b642-a109db0a519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:56.023483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312df77-4357-4197-a474-ea9528cb0f1e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:56.036816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a58d-4f71-4a71-803f-e61f156bf1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:56.039283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a58d-4f71-4a71-803f-e61f156bf1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:56.039663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a58d-4f71-4a71-803f-e61f156bf1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:56.039951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a58d-4f71-4a71-803f-e61f156bf1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:56.042048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a58d-4f71-4a71-803f-e61f156bf1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:56.048073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a58d-4f71-4a71-803f-e61f156bf1e5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:56.101068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65140a14-4f97-43fa-b642-a109db0a519e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:56.114772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:56.117536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:56.118210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:56.118775 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] PATH_INFO: `/v3/users/d2359b672db844c6a081df3267b0f9fd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:56.124233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2359b672db844c6a081df3267b0f9fd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:56.124765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1137/2265] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:55 2022] POST /identity/v3/projects => generated 389 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:56.126338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9140-94ae-428f-8fad-ffedb3f96d01 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:56.126634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9140-94ae-428f-8fad-ffedb3f96d01 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:56.126917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb9140-94ae-428f-8fad-ffedb3f96d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:56.127025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:56.157814 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f9eb9140-94ae-428f-8fad-ffedb3f96d01 None None] MFA Rules not processed for user `e1b76ba52fe447a5bbf620076c9140f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:56.159108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f9eb9140-94ae-428f-8fad-ffedb3f96d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:56.227021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2359b672db844c6a081df3267b0f9fd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:56.254584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2359b672db844c6a081df3267b0f9fd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:56.269227 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2359b672db844c6a081df3267b0f9fd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:56.270307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2359b672db844c6a081df3267b0f9fd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:56.281026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2359b672db844c6a081df3267b0f9fd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:56.281558 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1138/2266] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:56.283624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb9140-94ae-428f-8fad-ffedb3f96d01 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:56.297236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1129/2267] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:55 2022] DELETE /identity/v3/users/d2359b672db844c6a081df3267b0f9fd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:56.350690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:56.399422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb9140-94ae-428f-8fad-ffedb3f96d01 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:56.516185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39fc94-f676-438c-bdd3-9e1fb0d422a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:56.517641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39fc94-f676-438c-bdd3-9e1fb0d422a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:56.518080 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39fc94-f676-438c-bdd3-9e1fb0d422a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:56.518499 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39fc94-f676-438c-bdd3-9e1fb0d422a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:56.521112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39fc94-f676-438c-bdd3-9e1fb0d422a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:56.524066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39fc94-f676-438c-bdd3-9e1fb0d422a4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:56.555901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1139/2268] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:56 2022] POST /identity/v3/users => generated 301 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:56.560514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:56.562797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:56.581131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d2c8f-5b8d-4852-98d2-8c42380f131f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:56.588838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9daba8-14e3-47f0-9180-a93783758e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:56.590982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9daba8-14e3-47f0-9180-a93783758e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:56.591672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9daba8-14e3-47f0-9180-a93783758e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:56.592117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9daba8-14e3-47f0-9180-a93783758e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:56.593419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9daba8-14e3-47f0-9180-a93783758e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:56.596406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9daba8-14e3-47f0-9180-a93783758e6a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:56.609584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1130/2269] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:56.615195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39fc94-f676-438c-bdd3-9e1fb0d422a4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:56.626712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39fc94-f676-438c-bdd3-9e1fb0d422a4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:56.634362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f7397-4db4-4732-b5f2-693f2d4f59c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:56.635533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f7397-4db4-4732-b5f2-693f2d4f59c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:56.636052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f7397-4db4-4732-b5f2-693f2d4f59c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:56.636414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f7397-4db4-4732-b5f2-693f2d4f59c8 admin admin] PATH_INFO: `/v3/projects/578a243f53064259b5f754b242f47d78/users/b857f1a1585248d196873168ebfedea7/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:56.660157 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f7397-4db4-4732-b5f2-693f2d4f59c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578a243f53064259b5f754b242f47d78, user_id=b857f1a1585248d196873168ebfedea7, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:56.663733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f7397-4db4-4732-b5f2-693f2d4f59c8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:56.683569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1140/2270] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:56 2022] PUT /identity/v3/projects/578a243f53064259b5f754b242f47d78/users/b857f1a1585248d196873168ebfedea7/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:56.687970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9daba8-14e3-47f0-9180-a93783758e6a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:56.703753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9daba8-14e3-47f0-9180-a93783758e6a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:56.710996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:56.720134 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f7397-4db4-4732-b5f2-693f2d4f59c8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:56.722965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-365f7397-4db4-4732-b5f2-693f2d4f59c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:56.856971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f7397-4db4-4732-b5f2-693f2d4f59c8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:56.863247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:56.864926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:56.865389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:56.865677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] PATH_INFO: `/v3/projects/4963922b0fac423e866016b1fa2f0d1c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:56.867268 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4963922b0fac423e866016b1fa2f0d1c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:56.869552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3f710-a710-4354-9ffa-87d2c09a9447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:56.870374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:56.871354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3f710-a710-4354-9ffa-87d2c09a9447 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:56.872109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3f710-a710-4354-9ffa-87d2c09a9447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:56.872638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3f710-a710-4354-9ffa-87d2c09a9447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:56.873838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3f710-a710-4354-9ffa-87d2c09a9447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:56.876902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3f710-a710-4354-9ffa-87d2c09a9447 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:56.893320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1131/2271] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:56.900659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3f710-a710-4354-9ffa-87d2c09a9447 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:56.917486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3f710-a710-4354-9ffa-87d2c09a9447 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:56.924071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c26fc4-4778-4d5d-a5ec-734ca273e7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:56.924427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c26fc4-4778-4d5d-a5ec-734ca273e7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:56.924724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c26fc4-4778-4d5d-a5ec-734ca273e7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:56.925009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c26fc4-4778-4d5d-a5ec-734ca273e7fb admin admin] PATH_INFO: `/v3/projects/578a243f53064259b5f754b242f47d78/users/b857f1a1585248d196873168ebfedea7/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:56.928429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c26fc4-4778-4d5d-a5ec-734ca273e7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=578a243f53064259b5f754b242f47d78, user_id=b857f1a1585248d196873168ebfedea7, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:56.942531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4963922b0fac423e866016b1fa2f0d1c', 'request_id': 'req-677f4538-f4ed-4041-bf11-38b445fa36c7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:56.949101 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:56.950820 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c26fc4-4778-4d5d-a5ec-734ca273e7fb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:56.952515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4963922b0fac423e866016b1fa2f0d1c', 'request_id': 'req-677f4538-f4ed-4041-bf11-38b445fa36c7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:56.966817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4963922b0fac423e866016b1fa2f0d1c', 'request_id': 'req-677f4538-f4ed-4041-bf11-38b445fa36c7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:56.984307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1132/2272] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:56 2022] PUT /identity/v3/projects/578a243f53064259b5f754b242f47d78/users/b857f1a1585248d196873168ebfedea7/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:56.996185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d2c3d-4e09-4bcf-a409-e7fca125f473 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:56.996483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d2c3d-4e09-4bcf-a409-e7fca125f473 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:56.996766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d2c3d-4e09-4bcf-a409-e7fca125f473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:57.007526 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] The token cache is being invalidate because project 4963922b0fac423e866016b1fa2f0d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:00:57.007768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:57.008424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-677f4538-f4ed-4041-bf11-38b445fa36c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:57.010675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1141/2273] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:56 2022] DELETE /identity/v3/projects/4963922b0fac423e866016b1fa2f0d1c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:57.026145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16c6b-3c29-435b-aa9e-14a90940b009 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:57.026145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16c6b-3c29-435b-aa9e-14a90940b009 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:57.026145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16c6b-3c29-435b-aa9e-14a90940b009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:57.049164 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cf4d2c3d-4e09-4bcf-a409-e7fca125f473 None None] MFA Rules not processed for user `b857f1a1585248d196873168ebfedea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:57.050490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cf4d2c3d-4e09-4bcf-a409-e7fca125f473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:57.051650 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c2e16c6b-3c29-435b-aa9e-14a90940b009 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:57.053861 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c2e16c6b-3c29-435b-aa9e-14a90940b009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:57.161630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1142/2274] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:57.169915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b07d-467d-4b83-a26c-413c98a4c32b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:57.171450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b07d-467d-4b83-a26c-413c98a4c32b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:57.174134 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b07d-467d-4b83-a26c-413c98a4c32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:57.175360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1133/2275] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:00:57.182754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d2c3d-4e09-4bcf-a409-e7fca125f473 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:57.184613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cf4d2c3d-4e09-4bcf-a409-e7fca125f473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:57.217305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4f26b07d-467d-4b83-a26c-413c98a4c32b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:57.219095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4f26b07d-467d-4b83-a26c-413c98a4c32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:57.232133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1143/2276] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:00:57.236778 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26b07d-467d-4b83-a26c-413c98a4c32b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:57.253111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26b07d-467d-4b83-a26c-413c98a4c32b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:57.260864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217090-ba4c-436e-bfb6-4a59ba33ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:57.261945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217090-ba4c-436e-bfb6-4a59ba33ee0d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:57.262306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217090-ba4c-436e-bfb6-4a59ba33ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:57.262930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217090-ba4c-436e-bfb6-4a59ba33ee0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:57.266195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217090-ba4c-436e-bfb6-4a59ba33ee0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:00:57.266842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217090-ba4c-436e-bfb6-4a59ba33ee0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:57.269044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217090-ba4c-436e-bfb6-4a59ba33ee0d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:57.290710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1144/2277] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:00:57.291873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217090-ba4c-436e-bfb6-4a59ba33ee0d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:57.306259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d2c3d-4e09-4bcf-a409-e7fca125f473 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:57.307737 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217090-ba4c-436e-bfb6-4a59ba33ee0d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:57.311475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245422b-0c85-4b6c-a9bd-c7492c75ca2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:57.312284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245422b-0c85-4b6c-a9bd-c7492c75ca2f service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:57.312680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245422b-0c85-4b6c-a9bd-c7492c75ca2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:57.313069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245422b-0c85-4b6c-a9bd-c7492c75ca2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:57.314420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ace0bb-cf90-457a-b1fa-d0d4f5605116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:57.315709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ace0bb-cf90-457a-b1fa-d0d4f5605116 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:57.316122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ace0bb-cf90-457a-b1fa-d0d4f5605116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:57.316513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ace0bb-cf90-457a-b1fa-d0d4f5605116 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:57.317331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ace0bb-cf90-457a-b1fa-d0d4f5605116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:57.321241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ace0bb-cf90-457a-b1fa-d0d4f5605116 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:57.328303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245422b-0c85-4b6c-a9bd-c7492c75ca2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:57.329945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245422b-0c85-4b6c-a9bd-c7492c75ca2f service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:57.374403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1134/2278] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:00:57.384685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1145/2279] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:00:57 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:57.389865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245422b-0c85-4b6c-a9bd-c7492c75ca2f service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:57.416390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245422b-0c85-4b6c-a9bd-c7492c75ca2f service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:57.450168 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:57.586008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a27ade-aaa8-4d5b-808c-243bec5db815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:57.586721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27ade-aaa8-4d5b-808c-243bec5db815 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:57.587014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27ade-aaa8-4d5b-808c-243bec5db815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:57.587327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27ade-aaa8-4d5b-808c-243bec5db815 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:57.588056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a27ade-aaa8-4d5b-808c-243bec5db815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:57.590067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a27ade-aaa8-4d5b-808c-243bec5db815 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:57.659710 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1135/2280] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:00:57 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:00:57.665205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ace0bb-cf90-457a-b1fa-d0d4f5605116 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:57.689276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ace0bb-cf90-457a-b1fa-d0d4f5605116 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:57.709076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf46b66-cc05-4068-87fb-2f611dce216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:57.714441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46b66-cc05-4068-87fb-2f611dce216a admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:57.714748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46b66-cc05-4068-87fb-2f611dce216a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:57.715038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46b66-cc05-4068-87fb-2f611dce216a admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:57.716102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf46b66-cc05-4068-87fb-2f611dce216a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:57.717873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a27ade-aaa8-4d5b-808c-243bec5db815 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:57.719235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf46b66-cc05-4068-87fb-2f611dce216a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:57.720877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-94a27ade-aaa8-4d5b-808c-243bec5db815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:57.750043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1146/2281] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:57.751102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf46b66-cc05-4068-87fb-2f611dce216a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:57.754524 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3cf46b66-cc05-4068-87fb-2f611dce216a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:57.783910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a27ade-aaa8-4d5b-808c-243bec5db815 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:57.798386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf46b66-cc05-4068-87fb-2f611dce216a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:57.801808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:57.806819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:57.807367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:57.811992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] PATH_INFO: `/v3/users/12e306c49ff04f77bc587220a29338c9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:57.822470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e306c49ff04f77bc587220a29338c9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:57.823582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:57.824704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:57.825197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:57.826448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] PATH_INFO: `/v3/users/e6526316996d4b8ea5034082d5a052b2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:57.826589 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:57.828378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6526316996d4b8ea5034082d5a052b2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:57.831760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:57.993493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e306c49ff04f77bc587220a29338c9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:58.018250 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e306c49ff04f77bc587220a29338c9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:58.018501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6526316996d4b8ea5034082d5a052b2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:58.033282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e306c49ff04f77bc587220a29338c9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:58.035534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e306c49ff04f77bc587220a29338c9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:58.041366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6526316996d4b8ea5034082d5a052b2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:58.042726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6526316996d4b8ea5034082d5a052b2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:58.062371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e306c49ff04f77bc587220a29338c9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:58.066516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6526316996d4b8ea5034082d5a052b2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:58.070910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5998ef34-cd71-4596-82f9-94957ac995eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6526316996d4b8ea5034082d5a052b2'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:58.082978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1136/2282] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:57 2022] DELETE /identity/v3/users/12e306c49ff04f77bc587220a29338c9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:58.085208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:58.088944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:58.111958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1147/2283] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:00:57 2022] DELETE /identity/v3/users/e6526316996d4b8ea5034082d5a052b2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:58.113634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf13ef-c899-4af9-a5cc-2b6ace1ddfca None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:58.114158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf13ef-c899-4af9-a5cc-2b6ace1ddfca None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:58.114695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf13ef-c899-4af9-a5cc-2b6ace1ddfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:58.125078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:58.167522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-49bf13ef-c899-4af9-a5cc-2b6ace1ddfca None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:58.170542 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-49bf13ef-c899-4af9-a5cc-2b6ace1ddfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:58.244050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a21a8-3076-4bf9-9f2e-8a902e475ebb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:58.353810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:00:58.363794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1148/2284] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:58.370269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f707e5-b2ee-4853-a536-7088299ddc04 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:58.370567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f707e5-b2ee-4853-a536-7088299ddc04 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:58.373524 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f707e5-b2ee-4853-a536-7088299ddc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:58.412445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d4f707e5-b2ee-4853-a536-7088299ddc04 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:58.416497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d4f707e5-b2ee-4853-a536-7088299ddc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:58.436574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1149/2285] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:58.437942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f707e5-b2ee-4853-a536-7088299ddc04 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:58.439426 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d4f707e5-b2ee-4853-a536-7088299ddc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:58.446455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0332fa2-219f-486b-af3f-15eeb39269f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:58.447347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0332fa2-219f-486b-af3f-15eeb39269f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:58.447743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0332fa2-219f-486b-af3f-15eeb39269f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:58.448376 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0332fa2-219f-486b-af3f-15eeb39269f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:58.449247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0332fa2-219f-486b-af3f-15eeb39269f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:58.451011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0332fa2-219f-486b-af3f-15eeb39269f7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:58.470993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1137/2286] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:00:58.472018 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0332fa2-219f-486b-af3f-15eeb39269f7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:58.474059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b0332fa2-219f-486b-af3f-15eeb39269f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:58.549886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f707e5-b2ee-4853-a536-7088299ddc04 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:58.561239 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e22fba-70c3-4b84-b279-96f504cc99c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:58.563649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e22fba-70c3-4b84-b279-96f504cc99c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:58.563649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e22fba-70c3-4b84-b279-96f504cc99c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:58.564026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e22fba-70c3-4b84-b279-96f504cc99c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:58.588186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e22fba-70c3-4b84-b279-96f504cc99c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:58.593122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e22fba-70c3-4b84-b279-96f504cc99c9 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:58.597627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0332fa2-219f-486b-af3f-15eeb39269f7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:58.605463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2083ed-7395-4cb3-a528-31a4ecfc378d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:58.606316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2083ed-7395-4cb3-a528-31a4ecfc378d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:58.606861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2083ed-7395-4cb3-a528-31a4ecfc378d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:58.607368 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2083ed-7395-4cb3-a528-31a4ecfc378d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:58.614962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1150/2287] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:58.617454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e22fba-70c3-4b84-b279-96f504cc99c9 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:58.620476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-88e22fba-70c3-4b84-b279-96f504cc99c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:58.621277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2083ed-7395-4cb3-a528-31a4ecfc378d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:58.623491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2083ed-7395-4cb3-a528-31a4ecfc378d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:58.637962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1138/2288] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:00:58.648459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e22fba-70c3-4b84-b279-96f504cc99c9 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:58.659330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b7ba-79c0-4232-af68-78d6392332c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:58.661038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b7ba-79c0-4232-af68-78d6392332c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:58.661620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b7ba-79c0-4232-af68-78d6392332c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:58.663050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b7ba-79c0-4232-af68-78d6392332c4 admin admin] PATH_INFO: `/v3/projects/c0b220cc96e747b39c0cfaffe5446bfd/users/96c9297b1a444ab189d73da643625270/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:58.703909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72b7ba-79c0-4232-af68-78d6392332c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b220cc96e747b39c0cfaffe5446bfd, user_id=96c9297b1a444ab189d73da643625270, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:58.710074 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72b7ba-79c0-4232-af68-78d6392332c4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:58.741480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1151/2289] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:00:58 2022] PUT /identity/v3/projects/c0b220cc96e747b39c0cfaffe5446bfd/users/96c9297b1a444ab189d73da643625270/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:00:58.748469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12087f47-3a81-4c92-8ed3-aaeef44c62be None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:58.748469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12087f47-3a81-4c92-8ed3-aaeef44c62be None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:58.748971 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12087f47-3a81-4c92-8ed3-aaeef44c62be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:58.803430 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-12087f47-3a81-4c92-8ed3-aaeef44c62be None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:00:58.809563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-12087f47-3a81-4c92-8ed3-aaeef44c62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:58.955676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1139/2290] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:00:58.981914 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b7ba-79c0-4232-af68-78d6392332c4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:59.128040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b7ba-79c0-4232-af68-78d6392332c4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:59.140679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdf2fc-a220-42e9-a108-33dfc023c65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:59.143436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdf2fc-a220-42e9-a108-33dfc023c65a service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:59.143992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdf2fc-a220-42e9-a108-33dfc023c65a service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:59.144592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdf2fc-a220-42e9-a108-33dfc023c65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:59.166545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdf2fc-a220-42e9-a108-33dfc023c65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:59.168517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdf2fc-a220-42e9-a108-33dfc023c65a service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:59.187244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1152/2291] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:00:59.569466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12087f47-3a81-4c92-8ed3-aaeef44c62be None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:00:59.571606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-12087f47-3a81-4c92-8ed3-aaeef44c62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:00:59.596858 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12087f47-3a81-4c92-8ed3-aaeef44c62be None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:00:59.610327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:00:59.610918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:00:59.611250 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:00:59.611509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] PATH_INFO: `/v3/projects/b9a47c81a55e45a785d2925ec4fe239c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:00:59.614569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a47c81a55e45a785d2925ec4fe239c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:00:59.616973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:00:59.941478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a47c81a55e45a785d2925ec4fe239c', 'request_id': 'req-330cec8e-1449-4650-94e9-2dac522abd6b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:00:59.997792 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a47c81a55e45a785d2925ec4fe239c', 'request_id': 'req-330cec8e-1449-4650-94e9-2dac522abd6b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.026104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:00.030023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a47c81a55e45a785d2925ec4fe239c', 'request_id': 'req-330cec8e-1449-4650-94e9-2dac522abd6b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.076584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] The token cache is being invalidate because project b9a47c81a55e45a785d2925ec4fe239c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:00.077097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.078464 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.083579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1140/2292] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:00:59 2022] DELETE /identity/v3/projects/b9a47c81a55e45a785d2925ec4fe239c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:00.090588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdf2fc-a220-42e9-a108-33dfc023c65a service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:00.117374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:00.125453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:00.142769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdf2fc-a220-42e9-a108-33dfc023c65a service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:00.212239 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:00.338629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cec8e-1449-4650-94e9-2dac522abd6b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:00.348095 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:00.351003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:00.351003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:00.352357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] PATH_INFO: `/v3/projects/61b480d0914c41b5b9e0af744ad10f13` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:00.353890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b480d0914c41b5b9e0af744ad10f13)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:00.358211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:00.388298 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:00.391820 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:00.393005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:00.393005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] PATH_INFO: `/v3/users/b857f1a1585248d196873168ebfedea7` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:00.396846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b857f1a1585248d196873168ebfedea7)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:00.403352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:00.549246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b857f1a1585248d196873168ebfedea7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.556384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b480d0914c41b5b9e0af744ad10f13', 'request_id': 'req-5a9bef24-4d38-480d-a5da-4eeba1731676'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.577487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b480d0914c41b5b9e0af744ad10f13', 'request_id': 'req-5a9bef24-4d38-480d-a5da-4eeba1731676'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.579419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b857f1a1585248d196873168ebfedea7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.580375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b857f1a1585248d196873168ebfedea7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.601600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b480d0914c41b5b9e0af744ad10f13', 'request_id': 'req-5a9bef24-4d38-480d-a5da-4eeba1731676'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.604699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b857f1a1585248d196873168ebfedea7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.606300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b857f1a1585248d196873168ebfedea7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.632675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] The token cache is being invalidate because project 61b480d0914c41b5b9e0af744ad10f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:00.632675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.632675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:00.636951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1141/2293] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:00 2022] DELETE /identity/v3/projects/61b480d0914c41b5b9e0af744ad10f13 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:00.643448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:00.647380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:00.698945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1153/2294] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:00 2022] DELETE /identity/v3/users/b857f1a1585248d196873168ebfedea7 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:00.877665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bef24-4d38-480d-a5da-4eeba1731676 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:00.961636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:01.122975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:01.124990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:01.124990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:01.125495 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] PATH_INFO: `/v3/users/781e302b19c044fa8bb7c6e686428bc9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:01.128093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=781e302b19c044fa8bb7c6e686428bc9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:01.132176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:01.288793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781e302b19c044fa8bb7c6e686428bc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:01.323217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781e302b19c044fa8bb7c6e686428bc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:01.351969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781e302b19c044fa8bb7c6e686428bc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:01.352721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781e302b19c044fa8bb7c6e686428bc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:01.365992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fd9c009a-934d-40de-9a79-9e479a643fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781e302b19c044fa8bb7c6e686428bc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:01.378655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1142/2295] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:00 2022] DELETE /identity/v3/users/781e302b19c044fa8bb7c6e686428bc9 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:01.773077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:01.776378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:01.808568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6706ed9-d429-4597-b891-801792741fdc admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:01.966588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:01.967531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:01.967827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:01.968119 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] PATH_INFO: `/v3/projects/578a243f53064259b5f754b242f47d78` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:01.973930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=578a243f53064259b5f754b242f47d78)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:01.977955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:02.060408 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:02.074083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578a243f53064259b5f754b242f47d78', 'request_id': 'req-d513624d-5bf2-4248-919b-735ead397a8c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:02.095063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578a243f53064259b5f754b242f47d78', 'request_id': 'req-d513624d-5bf2-4248-919b-735ead397a8c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:02.109619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578a243f53064259b5f754b242f47d78', 'request_id': 'req-d513624d-5bf2-4248-919b-735ead397a8c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:02.140746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] The token cache is being invalidate because project 578a243f53064259b5f754b242f47d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:02.143446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:02.145433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d513624d-5bf2-4248-919b-735ead397a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:02.154631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1154/2296] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:01 2022] DELETE /identity/v3/projects/578a243f53064259b5f754b242f47d78 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:02.157844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53b2c-9de4-427c-8a3d-2e4460878e49 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:02.158442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53b2c-9de4-427c-8a3d-2e4460878e49 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:02.158863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53b2c-9de4-427c-8a3d-2e4460878e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:02.196905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6bf53b2c-9de4-427c-8a3d-2e4460878e49 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:02.199229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6bf53b2c-9de4-427c-8a3d-2e4460878e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:02.340651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1143/2297] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:02.351346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc459-39a5-4983-9d40-6c1ac66478f2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:02.351723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc459-39a5-4983-9d40-6c1ac66478f2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:02.351723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc459-39a5-4983-9d40-6c1ac66478f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:02.389924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-215dc459-39a5-4983-9d40-6c1ac66478f2 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:02.393161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-215dc459-39a5-4983-9d40-6c1ac66478f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:02.409049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1155/2298] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:02.414731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53b2c-9de4-427c-8a3d-2e4460878e49 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:02.429453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53b2c-9de4-427c-8a3d-2e4460878e49 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:02.438980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baf66d-a953-4392-bd3b-8c64441149cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:02.439726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baf66d-a953-4392-bd3b-8c64441149cf admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:02.440020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baf66d-a953-4392-bd3b-8c64441149cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:02.440307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baf66d-a953-4392-bd3b-8c64441149cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:02.441084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baf66d-a953-4392-bd3b-8c64441149cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:01:02.441400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baf66d-a953-4392-bd3b-8c64441149cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:02.444439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baf66d-a953-4392-bd3b-8c64441149cf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:02.469259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1144/2299] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:01:02.472945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dc459-39a5-4983-9d40-6c1ac66478f2 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:02.483770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dc459-39a5-4983-9d40-6c1ac66478f2 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:02.489011 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e7d0d-3fe1-4958-a12d-ea4af25fe1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:02.489712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e7d0d-3fe1-4958-a12d-ea4af25fe1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:02.490042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e7d0d-3fe1-4958-a12d-ea4af25fe1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:02.491002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e7d0d-3fe1-4958-a12d-ea4af25fe1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:02.491357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e7d0d-3fe1-4958-a12d-ea4af25fe1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:02.493461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e7d0d-3fe1-4958-a12d-ea4af25fe1d6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:02.550436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1156/2300] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:02 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:01:02.554635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baf66d-a953-4392-bd3b-8c64441149cf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:02.574124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baf66d-a953-4392-bd3b-8c64441149cf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:02.683126 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:02.771594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48649c7-eebb-4f22-ae15-22d2e49eee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:02.773059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48649c7-eebb-4f22-ae15-22d2e49eee1e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:02.773585 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48649c7-eebb-4f22-ae15-22d2e49eee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:02.774065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48649c7-eebb-4f22-ae15-22d2e49eee1e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:02.775026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48649c7-eebb-4f22-ae15-22d2e49eee1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:02.777298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48649c7-eebb-4f22-ae15-22d2e49eee1e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:02.821936 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1145/2301] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:02 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:01:02.828155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e7d0d-3fe1-4958-a12d-ea4af25fe1d6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:02.853330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e7d0d-3fe1-4958-a12d-ea4af25fe1d6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:02.863839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70006162-8d52-4787-a7eb-4b910dcd6f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:02.864636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006162-8d52-4787-a7eb-4b910dcd6f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:02.865103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006162-8d52-4787-a7eb-4b910dcd6f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:02.865540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006162-8d52-4787-a7eb-4b910dcd6f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:02.866991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70006162-8d52-4787-a7eb-4b910dcd6f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:02.868901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70006162-8d52-4787-a7eb-4b910dcd6f57 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:02.885237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1157/2302] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:02.889995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48649c7-eebb-4f22-ae15-22d2e49eee1e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:02.914086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48649c7-eebb-4f22-ae15-22d2e49eee1e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:02.925380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427fd77-a140-4d9b-a6f3-0fe7b8e032dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:02.926225 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427fd77-a140-4d9b-a6f3-0fe7b8e032dc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:02.926542 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427fd77-a140-4d9b-a6f3-0fe7b8e032dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:02.930318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427fd77-a140-4d9b-a6f3-0fe7b8e032dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:02.939196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427fd77-a140-4d9b-a6f3-0fe7b8e032dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:02.939196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427fd77-a140-4d9b-a6f3-0fe7b8e032dc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:02.985631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1146/2303] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:02.995877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70006162-8d52-4787-a7eb-4b910dcd6f57 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:03.015117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70006162-8d52-4787-a7eb-4b910dcd6f57 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:03.033872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a516cb-53d2-4aa0-aa01-379b7abcd9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:03.035057 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a516cb-53d2-4aa0-aa01-379b7abcd9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:03.035613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a516cb-53d2-4aa0-aa01-379b7abcd9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:03.037780 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a516cb-53d2-4aa0-aa01-379b7abcd9f8 admin admin] PATH_INFO: `/v3/projects/edf616fb00fb42ae969d32fccac34e23/users/5f36e0e3ff8942ccbaff6425f45dc1e8/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:03.081739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a516cb-53d2-4aa0-aa01-379b7abcd9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf616fb00fb42ae969d32fccac34e23, user_id=5f36e0e3ff8942ccbaff6425f45dc1e8, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:03.085563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a516cb-53d2-4aa0-aa01-379b7abcd9f8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:03.118149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1158/2304] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:02 2022] PUT /identity/v3/projects/edf616fb00fb42ae969d32fccac34e23/users/5f36e0e3ff8942ccbaff6425f45dc1e8/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:03.122870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaca60-e62e-4982-b2f5-072e984ca4d4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:03.124073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaca60-e62e-4982-b2f5-072e984ca4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:03.124571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaca60-e62e-4982-b2f5-072e984ca4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:03.164129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9fdaca60-e62e-4982-b2f5-072e984ca4d4 None None] MFA Rules not processed for user `5f36e0e3ff8942ccbaff6425f45dc1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:03.166918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9fdaca60-e62e-4982-b2f5-072e984ca4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:03.292762 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1147/2305] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:03.297839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a516cb-53d2-4aa0-aa01-379b7abcd9f8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:03.414099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a516cb-53d2-4aa0-aa01-379b7abcd9f8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:03.420103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc136e7-8479-4ddc-867d-6d745e19f1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:03.420390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc136e7-8479-4ddc-867d-6d745e19f1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:03.420715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc136e7-8479-4ddc-867d-6d745e19f1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:03.421132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc136e7-8479-4ddc-867d-6d745e19f1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:03.421864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc136e7-8479-4ddc-867d-6d745e19f1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:03.424161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc136e7-8479-4ddc-867d-6d745e19f1e5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:03.480161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1159/2306] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:03 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:03.485044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaca60-e62e-4982-b2f5-072e984ca4d4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:03.515141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaca60-e62e-4982-b2f5-072e984ca4d4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:03.659005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8355-0b45-4461-bed8-cd97567e14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:03.659598 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8355-0b45-4461-bed8-cd97567e14c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:03.659989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8355-0b45-4461-bed8-cd97567e14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:03.660279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8355-0b45-4461-bed8-cd97567e14c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:03.661126 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae8355-0b45-4461-bed8-cd97567e14c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:03.664778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae8355-0b45-4461-bed8-cd97567e14c0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:03.716860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1148/2307] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:03 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:03.722605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc136e7-8479-4ddc-867d-6d745e19f1e5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:03.749869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc136e7-8479-4ddc-867d-6d745e19f1e5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:03.758376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aac243-9c66-4792-bb39-768c87bba418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:03.760068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aac243-9c66-4792-bb39-768c87bba418 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:03.760466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aac243-9c66-4792-bb39-768c87bba418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:03.760868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aac243-9c66-4792-bb39-768c87bba418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:03.761968 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aac243-9c66-4792-bb39-768c87bba418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:03.765216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aac243-9c66-4792-bb39-768c87bba418 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:03.839427 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1160/2308] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:03.841945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8355-0b45-4461-bed8-cd97567e14c0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:03.870259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8355-0b45-4461-bed8-cd97567e14c0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:03.899856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828974ba-2a0b-4526-be33-de8168317509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:03.901854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828974ba-2a0b-4526-be33-de8168317509 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:03.904000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828974ba-2a0b-4526-be33-de8168317509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:03.906019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828974ba-2a0b-4526-be33-de8168317509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:03.908773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828974ba-2a0b-4526-be33-de8168317509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:03.910526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828974ba-2a0b-4526-be33-de8168317509 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:03.948921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1149/2309] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:01:03.957569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aac243-9c66-4792-bb39-768c87bba418 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:03.997212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aac243-9c66-4792-bb39-768c87bba418 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:04.014288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b584d9-71d4-4aa8-a82a-532cf465e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:04.016204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b584d9-71d4-4aa8-a82a-532cf465e5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:04.016916 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b584d9-71d4-4aa8-a82a-532cf465e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:04.017527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b584d9-71d4-4aa8-a82a-532cf465e5a0 admin admin] PATH_INFO: `/v3/projects/56d874ee468248fa891d513cf67a260e/users/4de2d24db9b347d599789d5bfa2858f0/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:04.065100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b584d9-71d4-4aa8-a82a-532cf465e5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d874ee468248fa891d513cf67a260e, user_id=4de2d24db9b347d599789d5bfa2858f0, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:04.073992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b584d9-71d4-4aa8-a82a-532cf465e5a0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:04.075256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828974ba-2a0b-4526-be33-de8168317509 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:04.078393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-828974ba-2a0b-4526-be33-de8168317509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:04.119778 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1161/2310] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:03 2022] PUT /identity/v3/projects/56d874ee468248fa891d513cf67a260e/users/4de2d24db9b347d599789d5bfa2858f0/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:04.131030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06622e2-4eba-4734-9775-794461377569 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:04.131545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06622e2-4eba-4734-9775-794461377569 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:04.131909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06622e2-4eba-4734-9775-794461377569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:04.149280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828974ba-2a0b-4526-be33-de8168317509 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:04.169052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:04.177072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a06622e2-4eba-4734-9775-794461377569 None None] MFA Rules not processed for user `4de2d24db9b347d599789d5bfa2858f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:04.193881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a06622e2-4eba-4734-9775-794461377569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:04.227138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:04.325350 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1162/2311] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:04.331238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06622e2-4eba-4734-9775-794461377569 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:04.370914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:04.373064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:04.373987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:04.374563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] PATH_INFO: `/v3/projects/fa196597617943ee8ffa775efb377b1b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:04.377386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa196597617943ee8ffa775efb377b1b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:04.385743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:04.550025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa196597617943ee8ffa775efb377b1b', 'request_id': 'req-4123e358-1736-482c-8771-5605753b4bda'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:04.559673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa196597617943ee8ffa775efb377b1b', 'request_id': 'req-4123e358-1736-482c-8771-5605753b4bda'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:04.574228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa196597617943ee8ffa775efb377b1b', 'request_id': 'req-4123e358-1736-482c-8771-5605753b4bda'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:04.608659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] The token cache is being invalidate because project fa196597617943ee8ffa775efb377b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:04.609176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:04.611756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4123e358-1736-482c-8771-5605753b4bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:04.619277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1150/2312] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:04 2022] DELETE /identity/v3/projects/fa196597617943ee8ffa775efb377b1b => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:04.627383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06622e2-4eba-4734-9775-794461377569 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:04.627626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3c12f-46f7-462b-8ba1-3c702ead813c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:04.627965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3c12f-46f7-462b-8ba1-3c702ead813c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:04.628538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3c12f-46f7-462b-8ba1-3c702ead813c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:04.727613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-eaf3c12f-46f7-462b-8ba1-3c702ead813c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:04.730678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eaf3c12f-46f7-462b-8ba1-3c702ead813c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:04.737940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e9aa5-544f-4d3f-bc9e-34b9cd459a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:04.741021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e9aa5-544f-4d3f-bc9e-34b9cd459a66 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:04.741964 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e9aa5-544f-4d3f-bc9e-34b9cd459a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:04.743539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e9aa5-544f-4d3f-bc9e-34b9cd459a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:04.744967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e9aa5-544f-4d3f-bc9e-34b9cd459a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:04.760967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e9aa5-544f-4d3f-bc9e-34b9cd459a66 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:04.780288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1151/2313] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:04.792809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19a84d-dfe0-40c8-9bc8-91e1edbfb629 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:04.793338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19a84d-dfe0-40c8-9bc8-91e1edbfb629 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:04.793851 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19a84d-dfe0-40c8-9bc8-91e1edbfb629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:04.853937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bc19a84d-dfe0-40c8-9bc8-91e1edbfb629 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:04.856591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bc19a84d-dfe0-40c8-9bc8-91e1edbfb629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:04.870247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1163/2314] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:04 2022] POST /identity/v3/projects => generated 383 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:01:04.872281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1152/2315] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:04.874641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e9aa5-544f-4d3f-bc9e-34b9cd459a66 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:04.878624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19a84d-dfe0-40c8-9bc8-91e1edbfb629 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:04.882557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5a9e9aa5-544f-4d3f-bc9e-34b9cd459a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:04.928491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19a84d-dfe0-40c8-9bc8-91e1edbfb629 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:05.033573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:05.109525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e9aa5-544f-4d3f-bc9e-34b9cd459a66 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:05.127702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed063fe-7e2b-48ee-8c54-9966e664f01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:05.129395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed063fe-7e2b-48ee-8c54-9966e664f01a admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:05.129692 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed063fe-7e2b-48ee-8c54-9966e664f01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:05.129981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed063fe-7e2b-48ee-8c54-9966e664f01a admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:05.134679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed063fe-7e2b-48ee-8c54-9966e664f01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:05.138255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed063fe-7e2b-48ee-8c54-9966e664f01a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:05.185854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707e98c-2791-4f47-9717-a1a5584c3495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:05.187639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707e98c-2791-4f47-9717-a1a5584c3495 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:05.188524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707e98c-2791-4f47-9717-a1a5584c3495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:05.188981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707e98c-2791-4f47-9717-a1a5584c3495 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:05.191211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707e98c-2791-4f47-9717-a1a5584c3495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:01:05.192067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707e98c-2791-4f47-9717-a1a5584c3495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:05.195216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1164/2316] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:04 2022] POST /identity/v3/users => generated 298 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:05.197247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707e98c-2791-4f47-9717-a1a5584c3495 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:05.197872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed063fe-7e2b-48ee-8c54-9966e664f01a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:05.232760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1153/2317] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:01:05.246076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707e98c-2791-4f47-9717-a1a5584c3495 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:05.248944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed063fe-7e2b-48ee-8c54-9966e664f01a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:05.266170 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447be466-a446-448a-887f-bc426ab78147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:05.267052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447be466-a446-448a-887f-bc426ab78147 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:05.267479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447be466-a446-448a-887f-bc426ab78147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:05.267970 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447be466-a446-448a-887f-bc426ab78147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:05.269228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447be466-a446-448a-887f-bc426ab78147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:05.271333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447be466-a446-448a-887f-bc426ab78147 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:05.288062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1165/2318] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:05.289181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447be466-a446-448a-887f-bc426ab78147 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:05.299191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707e98c-2791-4f47-9717-a1a5584c3495 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:05.300365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447be466-a446-448a-887f-bc426ab78147 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:05.307266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfc19e-b8fa-49de-a625-dba8cbd3a8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:05.307979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfc19e-b8fa-49de-a625-dba8cbd3a8f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:05.308270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfc19e-b8fa-49de-a625-dba8cbd3a8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:05.308619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfc19e-b8fa-49de-a625-dba8cbd3a8f2 admin admin] PATH_INFO: `/v3/projects/4962caec7c2b4700afbe2eac3e38337d/users/0017ef5af8e1434dad7763709a319545/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:05.310948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2727a09-cda1-4745-ab91-11219230f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:05.312455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2727a09-cda1-4745-ab91-11219230f409 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:05.313116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2727a09-cda1-4745-ab91-11219230f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:05.313789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2727a09-cda1-4745-ab91-11219230f409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:05.314706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2727a09-cda1-4745-ab91-11219230f409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:05.317215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2727a09-cda1-4745-ab91-11219230f409 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:05.337049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfc19e-b8fa-49de-a625-dba8cbd3a8f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4962caec7c2b4700afbe2eac3e38337d, user_id=0017ef5af8e1434dad7763709a319545, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:05.342430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfc19e-b8fa-49de-a625-dba8cbd3a8f2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:05.383240 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1166/2319] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:05 2022] PUT /identity/v3/projects/4962caec7c2b4700afbe2eac3e38337d/users/0017ef5af8e1434dad7763709a319545/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:05.385595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfc19e-b8fa-49de-a625-dba8cbd3a8f2 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:05.411698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1154/2320] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:05 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:05.414298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2727a09-cda1-4745-ab91-11219230f409 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:05.464289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:05.586790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfc19e-b8fa-49de-a625-dba8cbd3a8f2 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:05.716856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2727a09-cda1-4745-ab91-11219230f409 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:05.732087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365921f5-26c1-4a31-a386-85b895c01129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:05.733785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365921f5-26c1-4a31-a386-85b895c01129 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:05.734869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365921f5-26c1-4a31-a386-85b895c01129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:05.735521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365921f5-26c1-4a31-a386-85b895c01129 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:05.737779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365921f5-26c1-4a31-a386-85b895c01129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:05.745114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365921f5-26c1-4a31-a386-85b895c01129 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:05.746846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbd1a9-1f36-4222-875d-80d0b9a0a0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:05.748544 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbd1a9-1f36-4222-875d-80d0b9a0a0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:05.750231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbd1a9-1f36-4222-875d-80d0b9a0a0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:05.750816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbd1a9-1f36-4222-875d-80d0b9a0a0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:05.756741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbd1a9-1f36-4222-875d-80d0b9a0a0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:05.758882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbd1a9-1f36-4222-875d-80d0b9a0a0e0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:05.793471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1167/2321] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:05.809219 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbd1a9-1f36-4222-875d-80d0b9a0a0e0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:05.819240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1155/2322] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:05 2022] POST /identity/v3/users => generated 292 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:05.839894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbd1a9-1f36-4222-875d-80d0b9a0a0e0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:05.844416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365921f5-26c1-4a31-a386-85b895c01129 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:05.853134 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04636e32-7d89-4d1c-8c1d-b167d9b53d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:05.854141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04636e32-7d89-4d1c-8c1d-b167d9b53d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:05.854441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04636e32-7d89-4d1c-8c1d-b167d9b53d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:05.854742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04636e32-7d89-4d1c-8c1d-b167d9b53d75 admin admin] PATH_INFO: `/v3/projects/4962caec7c2b4700afbe2eac3e38337d/users/0017ef5af8e1434dad7763709a319545/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:05.859629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04636e32-7d89-4d1c-8c1d-b167d9b53d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4962caec7c2b4700afbe2eac3e38337d, user_id=0017ef5af8e1434dad7763709a319545, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:05.869795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04636e32-7d89-4d1c-8c1d-b167d9b53d75 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:05.879427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365921f5-26c1-4a31-a386-85b895c01129 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:05.904446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447552a0-0fa9-4dc9-9c7c-7247cb5f7cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:05.905166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447552a0-0fa9-4dc9-9c7c-7247cb5f7cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:05.905457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447552a0-0fa9-4dc9-9c7c-7247cb5f7cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:05.906580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447552a0-0fa9-4dc9-9c7c-7247cb5f7cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:05.906580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447552a0-0fa9-4dc9-9c7c-7247cb5f7cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:05.908236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447552a0-0fa9-4dc9-9c7c-7247cb5f7cbd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:05.925472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1168/2323] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:05 2022] PUT /identity/v3/projects/4962caec7c2b4700afbe2eac3e38337d/users/0017ef5af8e1434dad7763709a319545/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:05.950948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04636e32-7d89-4d1c-8c1d-b167d9b53d75 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:05.955635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1156/2324] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:05.957194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef6835-ca82-4d0c-8a51-0d6bd3e65c6d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:05.957491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef6835-ca82-4d0c-8a51-0d6bd3e65c6d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:05.957779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef6835-ca82-4d0c-8a51-0d6bd3e65c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:06.016131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-edef6835-ca82-4d0c-8a51-0d6bd3e65c6d None None] MFA Rules not processed for user `0017ef5af8e1434dad7763709a319545`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:06.018921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-edef6835-ca82-4d0c-8a51-0d6bd3e65c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:06.047346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:06.180417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04636e32-7d89-4d1c-8c1d-b167d9b53d75 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:06.185420 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1157/2325] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:06.194616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51381d-5422-40c4-9598-29045d7f9f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:06.196020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51381d-5422-40c4-9598-29045d7f9f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:06.196577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51381d-5422-40c4-9598-29045d7f9f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:06.197069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51381d-5422-40c4-9598-29045d7f9f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:06.197890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51381d-5422-40c4-9598-29045d7f9f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:06.199809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51381d-5422-40c4-9598-29045d7f9f78 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:06.211952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef6835-ca82-4d0c-8a51-0d6bd3e65c6d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:06.213707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-edef6835-ca82-4d0c-8a51-0d6bd3e65c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:06.220096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1169/2326] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:06.229521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51381d-5422-40c4-9598-29045d7f9f78 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:06.247998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51381d-5422-40c4-9598-29045d7f9f78 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:06.253634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9c2a9-fb5b-4bdc-aaee-efab7eeeb1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:06.255111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9c2a9-fb5b-4bdc-aaee-efab7eeeb1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:06.255111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9c2a9-fb5b-4bdc-aaee-efab7eeeb1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:06.256001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9c2a9-fb5b-4bdc-aaee-efab7eeeb1ec admin admin] PATH_INFO: `/v3/projects/86fcd1adb817477185c218619d4dcf9a/users/5823b3004a1f43acba67fb8b0d2384e4/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:06.280842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9c2a9-fb5b-4bdc-aaee-efab7eeeb1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fcd1adb817477185c218619d4dcf9a, user_id=5823b3004a1f43acba67fb8b0d2384e4, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:06.284008 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9c2a9-fb5b-4bdc-aaee-efab7eeeb1ec admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:06.311267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1170/2327] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:06 2022] PUT /identity/v3/projects/86fcd1adb817477185c218619d4dcf9a/users/5823b3004a1f43acba67fb8b0d2384e4/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:06.321673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a23e4c-13ae-4f2e-ac57-c32153ae6241 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:06.327302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef6835-ca82-4d0c-8a51-0d6bd3e65c6d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:06.331915 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a23e4c-13ae-4f2e-ac57-c32153ae6241 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:06.344618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a23e4c-13ae-4f2e-ac57-c32153ae6241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:06.400305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:06.431242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-56a23e4c-13ae-4f2e-ac57-c32153ae6241 None None] MFA Rules not processed for user `5823b3004a1f43acba67fb8b0d2384e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:06.433183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-56a23e4c-13ae-4f2e-ac57-c32153ae6241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:06.468373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760203-9724-4001-948d-b7114050db8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:06.468662 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760203-9724-4001-948d-b7114050db8d service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:06.469106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760203-9724-4001-948d-b7114050db8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:06.469228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760203-9724-4001-948d-b7114050db8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:06.475556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6760203-9724-4001-948d-b7114050db8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:06.613977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1171/2328] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:06.629284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a23e4c-13ae-4f2e-ac57-c32153ae6241 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:06.632846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-56a23e4c-13ae-4f2e-ac57-c32153ae6241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:06.680997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a23e4c-13ae-4f2e-ac57-c32153ae6241 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:06.691087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6760203-9724-4001-948d-b7114050db8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:06.692898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6760203-9724-4001-948d-b7114050db8d service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:06.694878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739c587-4cc1-4534-9df7-bddaa9c45faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:06.705177 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739c587-4cc1-4534-9df7-bddaa9c45faf service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:06.705831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739c587-4cc1-4534-9df7-bddaa9c45faf service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:06.706217 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739c587-4cc1-4534-9df7-bddaa9c45faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:06.725911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1158/2329] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:01:06.740346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739c587-4cc1-4534-9df7-bddaa9c45faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:06.743359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739c587-4cc1-4534-9df7-bddaa9c45faf service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:06.751036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760203-9724-4001-948d-b7114050db8d service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:06.758467 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6760203-9724-4001-948d-b7114050db8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:06.779315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1172/2330] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:01:07.028959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760203-9724-4001-948d-b7114050db8d service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:07.041254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:07.042171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:07.042755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:07.043048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] PATH_INFO: `/v3/users/2204aa6ef41f4d57b6c2f1b0591c9704` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:07.044518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2204aa6ef41f4d57b6c2f1b0591c9704)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:07.046796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:07.209461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2204aa6ef41f4d57b6c2f1b0591c9704'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:07.257456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2204aa6ef41f4d57b6c2f1b0591c9704'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:07.294165 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2204aa6ef41f4d57b6c2f1b0591c9704'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:07.295417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2204aa6ef41f4d57b6c2f1b0591c9704'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:07.309927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2204aa6ef41f4d57b6c2f1b0591c9704'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:07.330069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1159/2331] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:06 2022] DELETE /identity/v3/users/2204aa6ef41f4d57b6c2f1b0591c9704 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:07.882114 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739c587-4cc1-4534-9df7-bddaa9c45faf service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:07.905191 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739c587-4cc1-4534-9df7-bddaa9c45faf service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:08.065358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:08.067271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:08.068533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:08.069182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] PATH_INFO: `/v3/projects/414edfe9beff48599c2b0879ae29586b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:08.072087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414edfe9beff48599c2b0879ae29586b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:08.076457 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:08.098006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:08.168594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414edfe9beff48599c2b0879ae29586b', 'request_id': 'req-a26b3289-6ecb-48c6-8085-8bd5913fb306'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:08.180254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414edfe9beff48599c2b0879ae29586b', 'request_id': 'req-a26b3289-6ecb-48c6-8085-8bd5913fb306'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:08.195671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414edfe9beff48599c2b0879ae29586b', 'request_id': 'req-a26b3289-6ecb-48c6-8085-8bd5913fb306'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:08.223569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] The token cache is being invalidate because project 414edfe9beff48599c2b0879ae29586b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:08.223873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:08.225960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:08.231217 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1173/2332] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:07 2022] DELETE /identity/v3/projects/414edfe9beff48599c2b0879ae29586b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:08.234085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:08.236292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:08.254712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:08.269529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9621f89-d762-476a-be81-880d180b27f6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:08.446819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:08.449025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:08.449563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:08.454678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] PATH_INFO: `/v3/users/aa50cc46dd4f4e0a9eef3a5a9db15042` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:08.462611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa50cc46dd4f4e0a9eef3a5a9db15042)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:08.475244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:08.660306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa50cc46dd4f4e0a9eef3a5a9db15042'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:08.730538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa50cc46dd4f4e0a9eef3a5a9db15042'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:08.768767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa50cc46dd4f4e0a9eef3a5a9db15042'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:08.769840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa50cc46dd4f4e0a9eef3a5a9db15042'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:08.807431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa50cc46dd4f4e0a9eef3a5a9db15042'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:08.837715 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1160/2333] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:08 2022] DELETE /identity/v3/users/aa50cc46dd4f4e0a9eef3a5a9db15042 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:08.926895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:08.955897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:09.113785 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b3289-6ecb-48c6-8085-8bd5913fb306 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:09.271985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04050bf9-e2a4-4f01-9737-76e339b311ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:09.273849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04050bf9-e2a4-4f01-9737-76e339b311ea service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:09.275123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04050bf9-e2a4-4f01-9737-76e339b311ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:09.275123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04050bf9-e2a4-4f01-9737-76e339b311ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:09.278581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-04050bf9-e2a4-4f01-9737-76e339b311ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:09.391073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04050bf9-e2a4-4f01-9737-76e339b311ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:09.395654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04050bf9-e2a4-4f01-9737-76e339b311ea service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:09.409835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1174/2334] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:09.503516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:09.506512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:09.776544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e28060-8b76-4b48-94d1-5303251377e6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:09.784390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:09.785747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:09.786209 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:09.787323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] PATH_INFO: `/v3/projects/377a8771378f42d8bcd6a8e15795f4a8` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:09.791620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=377a8771378f42d8bcd6a8e15795f4a8)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:09.795595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:09.837023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:09.906178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377a8771378f42d8bcd6a8e15795f4a8', 'request_id': 'req-50421fd0-e062-4356-9bf9-543fb6476c20'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:09.919782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377a8771378f42d8bcd6a8e15795f4a8', 'request_id': 'req-50421fd0-e062-4356-9bf9-543fb6476c20'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:09.942183 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377a8771378f42d8bcd6a8e15795f4a8', 'request_id': 'req-50421fd0-e062-4356-9bf9-543fb6476c20'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:09.975334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] The token cache is being invalidate because project 377a8771378f42d8bcd6a8e15795f4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:09.975649 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:09.983471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-50421fd0-e062-4356-9bf9-543fb6476c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:09.993550 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1161/2335] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:09 2022] DELETE /identity/v3/projects/377a8771378f42d8bcd6a8e15795f4a8 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:10.001529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23a24-6a06-45c9-99f0-d2e6ea351d73 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:10.002444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23a24-6a06-45c9-99f0-d2e6ea351d73 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:10.002591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23a24-6a06-45c9-99f0-d2e6ea351d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:10.054054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2cc23a24-6a06-45c9-99f0-d2e6ea351d73 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:10.059959 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2cc23a24-6a06-45c9-99f0-d2e6ea351d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:10.072755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:10.286749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1175/2336] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:10.309876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153213b2-a5ba-406b-ba18-99edcf934b81 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:10.310451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153213b2-a5ba-406b-ba18-99edcf934b81 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:10.311044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153213b2-a5ba-406b-ba18-99edcf934b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:10.404485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-153213b2-a5ba-406b-ba18-99edcf934b81 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:10.405819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-153213b2-a5ba-406b-ba18-99edcf934b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:10.456758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23a24-6a06-45c9-99f0-d2e6ea351d73 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:10.458855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1162/2337] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:10.485395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23a24-6a06-45c9-99f0-d2e6ea351d73 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:10.520537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489339b-1d59-4922-a268-f3c304595244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:10.525514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489339b-1d59-4922-a268-f3c304595244 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:10.525514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489339b-1d59-4922-a268-f3c304595244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:10.525514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489339b-1d59-4922-a268-f3c304595244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:10.525514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489339b-1d59-4922-a268-f3c304595244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:01:10.525514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489339b-1d59-4922-a268-f3c304595244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:10.527039 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489339b-1d59-4922-a268-f3c304595244 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:10.602223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153213b2-a5ba-406b-ba18-99edcf934b81 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:10.604224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1176/2338] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:01:10.673352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153213b2-a5ba-406b-ba18-99edcf934b81 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:10.717536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810310d-0837-4e17-9ee4-70e6018a18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:10.718701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810310d-0837-4e17-9ee4-70e6018a18b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:10.719107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810310d-0837-4e17-9ee4-70e6018a18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:10.719551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810310d-0837-4e17-9ee4-70e6018a18b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:10.726519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810310d-0837-4e17-9ee4-70e6018a18b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:10.733203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810310d-0837-4e17-9ee4-70e6018a18b9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:10.804414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1163/2339] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:10 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:10.809357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489339b-1d59-4922-a268-f3c304595244 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:10.845120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489339b-1d59-4922-a268-f3c304595244 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:11.068815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee394-c562-464b-be0d-3021b58b250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:11.070614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee394-c562-464b-be0d-3021b58b250e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:11.072037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee394-c562-464b-be0d-3021b58b250e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:11.072822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee394-c562-464b-be0d-3021b58b250e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:11.074447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ee394-c562-464b-be0d-3021b58b250e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:11.079642 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ee394-c562-464b-be0d-3021b58b250e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:11.143895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1177/2340] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:10 2022] POST /identity/v3/users => generated 286 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:01:11.145489 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810310d-0837-4e17-9ee4-70e6018a18b9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:11.156638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee394-c562-464b-be0d-3021b58b250e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:11.165066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-108ee394-c562-464b-be0d-3021b58b250e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:11.168537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810310d-0837-4e17-9ee4-70e6018a18b9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:11.189213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75616a4-4f3c-4295-95b0-a69012a431d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:11.190366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75616a4-4f3c-4295-95b0-a69012a431d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:11.190612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75616a4-4f3c-4295-95b0-a69012a431d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:11.200037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75616a4-4f3c-4295-95b0-a69012a431d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:11.201369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75616a4-4f3c-4295-95b0-a69012a431d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:11.205685 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75616a4-4f3c-4295-95b0-a69012a431d5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:11.233188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1164/2341] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:11.234329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75616a4-4f3c-4295-95b0-a69012a431d5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:11.258739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75616a4-4f3c-4295-95b0-a69012a431d5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:11.268949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b33be-e4c5-4c96-bd24-92dcc5fab93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:11.269825 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b33be-e4c5-4c96-bd24-92dcc5fab93e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:11.270360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b33be-e4c5-4c96-bd24-92dcc5fab93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:11.270775 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b33be-e4c5-4c96-bd24-92dcc5fab93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:11.272787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b33be-e4c5-4c96-bd24-92dcc5fab93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:11.282734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b33be-e4c5-4c96-bd24-92dcc5fab93e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:11.318677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee394-c562-464b-be0d-3021b58b250e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:11.322438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1165/2342] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:11.324060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b33be-e4c5-4c96-bd24-92dcc5fab93e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:11.329934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b47ad-d040-464f-961a-a860c93dc22d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:11.330996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b47ad-d040-464f-961a-a860c93dc22d service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:11.333075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b47ad-d040-464f-961a-a860c93dc22d service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:11.334898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b47ad-d040-464f-961a-a860c93dc22d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:11.338924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0d7b47ad-d040-464f-961a-a860c93dc22d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:11.355319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b33be-e4c5-4c96-bd24-92dcc5fab93e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:11.383199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e3e47-2789-4801-8408-ebb4ad755114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:11.384573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e3e47-2789-4801-8408-ebb4ad755114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:11.385117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e3e47-2789-4801-8408-ebb4ad755114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:11.387271 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e3e47-2789-4801-8408-ebb4ad755114 admin admin] PATH_INFO: `/v3/projects/f84c2009003c42148343ce83f31f9a1c/users/f1490ebb04a84da3bf980b5c6051d3f3/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:11.420985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e3e47-2789-4801-8408-ebb4ad755114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84c2009003c42148343ce83f31f9a1c, user_id=f1490ebb04a84da3bf980b5c6051d3f3, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:11.424680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e3e47-2789-4801-8408-ebb4ad755114 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:11.451766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1166/2343] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:11 2022] PUT /identity/v3/projects/f84c2009003c42148343ce83f31f9a1c/users/f1490ebb04a84da3bf980b5c6051d3f3/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:11.471963 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532ec74-7d72-41ea-a082-264206a703cb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:11.472680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532ec74-7d72-41ea-a082-264206a703cb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:11.473258 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532ec74-7d72-41ea-a082-264206a703cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:11.534667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:11.546643 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c532ec74-7d72-41ea-a082-264206a703cb None None] MFA Rules not processed for user `f1490ebb04a84da3bf980b5c6051d3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:11.549212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c532ec74-7d72-41ea-a082-264206a703cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:11.594581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b47ad-d040-464f-961a-a860c93dc22d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:11.596434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b47ad-d040-464f-961a-a860c93dc22d service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:11.627976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1178/2344] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:11.661392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1167/2345] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:11.691534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b47ad-d040-464f-961a-a860c93dc22d service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:11.695271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0d7b47ad-d040-464f-961a-a860c93dc22d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:11.737837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b47ad-d040-464f-961a-a860c93dc22d service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:11.990842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe5f0b-088a-4366-9608-1533d9ed5ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:11.996696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5f0b-088a-4366-9608-1533d9ed5ffd service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:11.997226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5f0b-088a-4366-9608-1533d9ed5ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:11.997719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe5f0b-088a-4366-9608-1533d9ed5ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:12.073905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe5f0b-088a-4366-9608-1533d9ed5ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:12.076948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe5f0b-088a-4366-9608-1533d9ed5ffd service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:12.122038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1179/2346] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:12.147348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532ec74-7d72-41ea-a082-264206a703cb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:12.468351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:12.627041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532ec74-7d72-41ea-a082-264206a703cb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:12.655104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:12.658278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:12.659827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:12.660318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] PATH_INFO: `/v3/users/f1490ebb04a84da3bf980b5c6051d3f3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:12.664156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1490ebb04a84da3bf980b5c6051d3f3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:12.670627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:12.811328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1490ebb04a84da3bf980b5c6051d3f3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:12.843297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1490ebb04a84da3bf980b5c6051d3f3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:12.867089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1490ebb04a84da3bf980b5c6051d3f3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:12.868071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1490ebb04a84da3bf980b5c6051d3f3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:12.877725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1490ebb04a84da3bf980b5c6051d3f3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:12.898964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1168/2347] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:12 2022] DELETE /identity/v3/users/f1490ebb04a84da3bf980b5c6051d3f3 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:12.899828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88884e46-5461-42c2-8642-d84559727af8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:12.900286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88884e46-5461-42c2-8642-d84559727af8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:12.900740 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88884e46-5461-42c2-8642-d84559727af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:12.924640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-88884e46-5461-42c2-8642-d84559727af8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:12.926668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-88884e46-5461-42c2-8642-d84559727af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:13.247000 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1180/2348] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:13.282164 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:13.283896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:13.480578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307d672-8951-4c94-8551-2d535b2e0f2e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:13.504454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0308a0-f8e0-4f45-9aa5-aa6b11c79864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:13.511306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0308a0-f8e0-4f45-9aa5-aa6b11c79864 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:13.511805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0308a0-f8e0-4f45-9aa5-aa6b11c79864 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:13.512145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0308a0-f8e0-4f45-9aa5-aa6b11c79864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:13.545089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0308a0-f8e0-4f45-9aa5-aa6b11c79864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:13.550507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0308a0-f8e0-4f45-9aa5-aa6b11c79864 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:13.575690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1169/2349] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:14.758609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375af33-70ae-4566-843c-52cde22746b4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:14.759704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375af33-70ae-4566-843c-52cde22746b4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:14.759704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375af33-70ae-4566-843c-52cde22746b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:14.854442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c375af33-70ae-4566-843c-52cde22746b4 None None] MFA Rules not processed for user `96c9297b1a444ab189d73da643625270`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:14.859260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c375af33-70ae-4566-843c-52cde22746b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:14.903063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0308a0-f8e0-4f45-9aa5-aa6b11c79864 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:14.905710 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3c0308a0-f8e0-4f45-9aa5-aa6b11c79864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:14.965795 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0308a0-f8e0-4f45-9aa5-aa6b11c79864 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:14.983061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:14.985610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:14.986085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:14.986550 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] PATH_INFO: `/v3/projects/f84c2009003c42148343ce83f31f9a1c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:14.989657 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84c2009003c42148343ce83f31f9a1c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:14.994131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:15.068161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1181/2350] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:15.071122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ca45-0cd3-467e-b281-00ff5efaf396 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:15.071691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ca45-0cd3-467e-b281-00ff5efaf396 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:15.072229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ca45-0cd3-467e-b281-00ff5efaf396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:15.107066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:15.112275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:15.120559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84c2009003c42148343ce83f31f9a1c', 'request_id': 'req-d76c505a-283f-4d98-9100-c870d56d3568'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:15.129584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84c2009003c42148343ce83f31f9a1c', 'request_id': 'req-d76c505a-283f-4d98-9100-c870d56d3568'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:15.137572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84c2009003c42148343ce83f31f9a1c', 'request_id': 'req-d76c505a-283f-4d98-9100-c870d56d3568'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:15.155396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] The token cache is being invalidate because project f84c2009003c42148343ce83f31f9a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:15.155703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:15.156997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:15.158740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1170/2351] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:14 2022] DELETE /identity/v3/projects/f84c2009003c42148343ce83f31f9a1c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:15.159819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:15.161587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:15.211654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b651ca45-0cd3-467e-b281-00ff5efaf396 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:15.213162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b651ca45-0cd3-467e-b281-00ff5efaf396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:15.317406 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1182/2352] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:15.320245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffad6c2-5622-450d-98af-f781d89a4875 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:15.320559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffad6c2-5622-450d-98af-f781d89a4875 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:15.320845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffad6c2-5622-450d-98af-f781d89a4875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:15.351784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2ffad6c2-5622-450d-98af-f781d89a4875 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:15.353186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2ffad6c2-5622-450d-98af-f781d89a4875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:15.367491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c505a-283f-4d98-9100-c870d56d3568 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:15.376772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34c9b6-0004-49f2-8158-6601de2e566d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:15.378354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34c9b6-0004-49f2-8158-6601de2e566d service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:15.378516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34c9b6-0004-49f2-8158-6601de2e566d service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:15.378868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34c9b6-0004-49f2-8158-6601de2e566d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:15.389768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1d34c9b6-0004-49f2-8158-6601de2e566d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:15.495765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1183/2353] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:15.496028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffad6c2-5622-450d-98af-f781d89a4875 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:15.503245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2ffad6c2-5622-450d-98af-f781d89a4875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:15.518491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34c9b6-0004-49f2-8158-6601de2e566d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:15.520964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34c9b6-0004-49f2-8158-6601de2e566d service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:15.538532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1171/2354] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:15.540084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1690108-1fa2-4abe-93be-c7b35dfed4df None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:15.540560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1690108-1fa2-4abe-93be-c7b35dfed4df None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:15.541638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1690108-1fa2-4abe-93be-c7b35dfed4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:15.569853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c1690108-1fa2-4abe-93be-c7b35dfed4df None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:15.570235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c1690108-1fa2-4abe-93be-c7b35dfed4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:15.579703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1172/2355] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:15.585959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1690108-1fa2-4abe-93be-c7b35dfed4df None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:15.598149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1690108-1fa2-4abe-93be-c7b35dfed4df None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:15.610142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2af58-ca54-4019-9cc7-f919d1f8560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:15.610848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2af58-ca54-4019-9cc7-f919d1f8560d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:15.612628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2af58-ca54-4019-9cc7-f919d1f8560d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:15.613090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2af58-ca54-4019-9cc7-f919d1f8560d admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:15.613688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2af58-ca54-4019-9cc7-f919d1f8560d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:01:15.614059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2af58-ca54-4019-9cc7-f919d1f8560d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:15.616572 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2af58-ca54-4019-9cc7-f919d1f8560d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:15.649703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1173/2356] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:01:15.655090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2af58-ca54-4019-9cc7-f919d1f8560d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:15.662445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:15.682556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2af58-ca54-4019-9cc7-f919d1f8560d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:15.689233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1a29-62a3-4005-9491-a007f14f00cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:15.690171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1a29-62a3-4005-9491-a007f14f00cc admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:15.690663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1a29-62a3-4005-9491-a007f14f00cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:15.691051 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a1a29-62a3-4005-9491-a007f14f00cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:15.696295 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a1a29-62a3-4005-9491-a007f14f00cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:15.704878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a1a29-62a3-4005-9491-a007f14f00cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:15.757352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1174/2357] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:15 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:15.759107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1a29-62a3-4005-9491-a007f14f00cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:15.759641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffad6c2-5622-450d-98af-f781d89a4875 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:15.791956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:15.964010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531fe88-7f9b-4044-ba0b-637dd5ab27ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:15.965012 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531fe88-7f9b-4044-ba0b-637dd5ab27ed service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:15.965375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531fe88-7f9b-4044-ba0b-637dd5ab27ed service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:15.965719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531fe88-7f9b-4044-ba0b-637dd5ab27ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:16.003102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a1a29-62a3-4005-9491-a007f14f00cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:16.014625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9116f1-511c-4ad8-af00-d75a6b1ac9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:16.015362 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9116f1-511c-4ad8-af00-d75a6b1ac9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:16.015660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9116f1-511c-4ad8-af00-d75a6b1ac9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:16.015943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9116f1-511c-4ad8-af00-d75a6b1ac9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:16.016927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9116f1-511c-4ad8-af00-d75a6b1ac9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:16.019330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9116f1-511c-4ad8-af00-d75a6b1ac9f2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:16.060898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1175/2358] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:15 2022] POST /identity/v3/users => generated 288 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:16.068554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9116f1-511c-4ad8-af00-d75a6b1ac9f2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:16.093866 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9116f1-511c-4ad8-af00-d75a6b1ac9f2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:16.103059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b8478-ca9b-4f28-bd8c-eae385265253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:16.104261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b8478-ca9b-4f28-bd8c-eae385265253 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:16.104952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b8478-ca9b-4f28-bd8c-eae385265253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:16.105345 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b8478-ca9b-4f28-bd8c-eae385265253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:16.107990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b8478-ca9b-4f28-bd8c-eae385265253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:16.121693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b8478-ca9b-4f28-bd8c-eae385265253 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:16.141122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531fe88-7f9b-4044-ba0b-637dd5ab27ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:16.144695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531fe88-7f9b-4044-ba0b-637dd5ab27ed service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:16.158514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1176/2359] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:01:16.166222 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b8478-ca9b-4f28-bd8c-eae385265253 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:16.195113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1184/2360] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:01:16.214685 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b8478-ca9b-4f28-bd8c-eae385265253 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:16.218986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc031d-53a6-4575-86a4-b44569ea25b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:16.220030 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc031d-53a6-4575-86a4-b44569ea25b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:16.220324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc031d-53a6-4575-86a4-b44569ea25b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:16.220645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc031d-53a6-4575-86a4-b44569ea25b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:16.221428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc031d-53a6-4575-86a4-b44569ea25b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:16.231887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc031d-53a6-4575-86a4-b44569ea25b8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:16.299522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1177/2361] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:16.309573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531fe88-7f9b-4044-ba0b-637dd5ab27ed service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:16.337165 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531fe88-7f9b-4044-ba0b-637dd5ab27ed service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:16.344257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80244fc-f571-47a9-ab68-c393cc643ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:16.345310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80244fc-f571-47a9-ab68-c393cc643ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:16.345667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80244fc-f571-47a9-ab68-c393cc643ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:16.346010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80244fc-f571-47a9-ab68-c393cc643ceb admin admin] PATH_INFO: `/v3/projects/42d43da7829a400fa58e6155346be5eb/users/9644a3dbddfd49caaeb2c3421886f85b/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:16.374873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80244fc-f571-47a9-ab68-c393cc643ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d43da7829a400fa58e6155346be5eb, user_id=9644a3dbddfd49caaeb2c3421886f85b, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:16.384455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80244fc-f571-47a9-ab68-c393cc643ceb admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:16.417167 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1185/2362] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:16 2022] PUT /identity/v3/projects/42d43da7829a400fa58e6155346be5eb/users/9644a3dbddfd49caaeb2c3421886f85b/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:16.431914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d053ff-f397-4ef0-a370-78d0ade0a7ee None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:16.432747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d053ff-f397-4ef0-a370-78d0ade0a7ee None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:16.433659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d053ff-f397-4ef0-a370-78d0ade0a7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:16.503035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-69d053ff-f397-4ef0-a370-78d0ade0a7ee None None] MFA Rules not processed for user `9644a3dbddfd49caaeb2c3421886f85b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:16.505927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69d053ff-f397-4ef0-a370-78d0ade0a7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:16.619459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1178/2363] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:16.640001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80244fc-f571-47a9-ab68-c393cc643ceb admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:16.644211 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b80244fc-f571-47a9-ab68-c393cc643ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:16.880278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:16.897063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80244fc-f571-47a9-ab68-c393cc643ceb admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:16.912163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13a093-4875-4d03-b88e-2b1a6c86d7ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61565364dbac41cfac76195c0be88771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:16.912514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13a093-4875-4d03-b88e-2b1a6c86d7ae service glance] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:16.912669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13a093-4875-4d03-b88e-2b1a6c86d7ae service glance] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:16.913280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13a093-4875-4d03-b88e-2b1a6c86d7ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:16.935505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13a093-4875-4d03-b88e-2b1a6c86d7ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:16.937524 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13a093-4875-4d03-b88e-2b1a6c86d7ae service glance] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:16.968306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1186/2364] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:16.974703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d053ff-f397-4ef0-a370-78d0ade0a7ee None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:16.983415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69d053ff-f397-4ef0-a370-78d0ade0a7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:17.384311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d053ff-f397-4ef0-a370-78d0ade0a7ee None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:17.412977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:17.414621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:17.415130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:17.415678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] PATH_INFO: `/v3/users/5823b3004a1f43acba67fb8b0d2384e4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:17.419642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5823b3004a1f43acba67fb8b0d2384e4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:17.427479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:17.451003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:17.621403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5823b3004a1f43acba67fb8b0d2384e4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:17.658601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5823b3004a1f43acba67fb8b0d2384e4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:17.700805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5823b3004a1f43acba67fb8b0d2384e4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:17.701900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5823b3004a1f43acba67fb8b0d2384e4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:17.735918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d94bf797-e292-4214-b87b-501d8a87fbe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5823b3004a1f43acba67fb8b0d2384e4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:17.773956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1179/2365] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:16 2022] DELETE /identity/v3/users/5823b3004a1f43acba67fb8b0d2384e4 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:17.781391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac54b9-359a-4bdb-8264-f35c4b4bd9b1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:17.782031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac54b9-359a-4bdb-8264-f35c4b4bd9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:17.783092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac54b9-359a-4bdb-8264-f35c4b4bd9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:17.850584 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596799-aede-44ff-8311-6e853aef1b11 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:17.857198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596799-aede-44ff-8311-6e853aef1b11 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:17.858874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596799-aede-44ff-8311-6e853aef1b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:17.901257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ebac54b9-359a-4bdb-8264-f35c4b4bd9b1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:17.914260 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ebac54b9-359a-4bdb-8264-f35c4b4bd9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:17.930421 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b4596799-aede-44ff-8311-6e853aef1b11 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:17.941665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b4596799-aede-44ff-8311-6e853aef1b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:18.244726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1187/2366] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:18.251989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1180/2367] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jun 21 16:01:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 21 16:01:18.265848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac54b9-359a-4bdb-8264-f35c4b4bd9b1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:18.271515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ebac54b9-359a-4bdb-8264-f35c4b4bd9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:18.280699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596799-aede-44ff-8311-6e853aef1b11 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:18.283379 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b4596799-aede-44ff-8311-6e853aef1b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:18.617438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac54b9-359a-4bdb-8264-f35c4b4bd9b1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:18.651189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d14d6-6d1a-4225-a423-b0f1160d1d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:18.654819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d14d6-6d1a-4225-a423-b0f1160d1d22 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:18.656747 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d14d6-6d1a-4225-a423-b0f1160d1d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:18.657576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d14d6-6d1a-4225-a423-b0f1160d1d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:18.684552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596799-aede-44ff-8311-6e853aef1b11 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:18.685151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d14d6-6d1a-4225-a423-b0f1160d1d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:18.689446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d14d6-6d1a-4225-a423-b0f1160d1d22 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:18.704036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c709e-bad1-4be7-8601-3679dfb93829 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:18.704878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c709e-bad1-4be7-8601-3679dfb93829 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:18.705152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c709e-bad1-4be7-8601-3679dfb93829 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:18.705448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c709e-bad1-4be7-8601-3679dfb93829 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:18.724481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c709e-bad1-4be7-8601-3679dfb93829 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:18.731185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c709e-bad1-4be7-8601-3679dfb93829 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:18.739809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1188/2368] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:18.745479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d14d6-6d1a-4225-a423-b0f1160d1d22 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:18.750344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-055d14d6-6d1a-4225-a423-b0f1160d1d22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:18.756270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1181/2369] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:01:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:01:18.835797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d14d6-6d1a-4225-a423-b0f1160d1d22 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:18.891097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:18.894603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:18.895953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:18.898656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] PATH_INFO: `/v3/users/5f36e0e3ff8942ccbaff6425f45dc1e8` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:18.915903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f36e0e3ff8942ccbaff6425f45dc1e8)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:18.923258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:19.110293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f36e0e3ff8942ccbaff6425f45dc1e8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:19.161933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f36e0e3ff8942ccbaff6425f45dc1e8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:19.163884 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f36e0e3ff8942ccbaff6425f45dc1e8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:19.187921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f36e0e3ff8942ccbaff6425f45dc1e8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:19.188966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f36e0e3ff8942ccbaff6425f45dc1e8'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:19.236263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1189/2370] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:18 2022] DELETE /identity/v3/users/5f36e0e3ff8942ccbaff6425f45dc1e8 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:19.243038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c296-4f7b-42f9-8afa-f3d313576f03 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:19.243826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c296-4f7b-42f9-8afa-f3d313576f03 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:19.244334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c296-4f7b-42f9-8afa-f3d313576f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:19.289314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8451c296-4f7b-42f9-8afa-f3d313576f03 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:19.292056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8451c296-4f7b-42f9-8afa-f3d313576f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:19.372990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:19.488004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1182/2371] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:19.506241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:19.509288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:19.524174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:19.604937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb74834-9b39-4506-a96a-7066466347ac None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:19.604937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb74834-9b39-4506-a96a-7066466347ac None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:19.605359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb74834-9b39-4506-a96a-7066466347ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:19.649113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2cb74834-9b39-4506-a96a-7066466347ac None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:19.653037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cb74834-9b39-4506-a96a-7066466347ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:19.690095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d7e2f-3733-4637-a34f-b1ee968e48b8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:19.706105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9e51-b6f8-4102-8215-142d915ce5b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:19.706917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9e51-b6f8-4102-8215-142d915ce5b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:19.707202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9e51-b6f8-4102-8215-142d915ce5b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:19.707630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae9e51-b6f8-4102-8215-142d915ce5b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:19.730955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9e51-b6f8-4102-8215-142d915ce5b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:19.738917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae9e51-b6f8-4102-8215-142d915ce5b0 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:19.762040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1190/2372] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:19.767518 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9e51-b6f8-4102-8215-142d915ce5b0 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:19.771283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0eae9e51-b6f8-4102-8215-142d915ce5b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:19.806305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1183/2373] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:19.828614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb74834-9b39-4506-a96a-7066466347ac None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:19.830169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cb74834-9b39-4506-a96a-7066466347ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:19.896780 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae9e51-b6f8-4102-8215-142d915ce5b0 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:19.926069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:19.929936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:19.935751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:19.936563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] PATH_INFO: `/v3/projects/86fcd1adb817477185c218619d4dcf9a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:19.946175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fcd1adb817477185c218619d4dcf9a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:19.954638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:19.991834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb74834-9b39-4506-a96a-7066466347ac None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:20.003153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06160b47-0327-40d3-9287-234833464d60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:20.004020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160b47-0327-40d3-9287-234833464d60 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:20.004574 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160b47-0327-40d3-9287-234833464d60 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:20.005781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160b47-0327-40d3-9287-234833464d60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:20.022191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06160b47-0327-40d3-9287-234833464d60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:20.024103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06160b47-0327-40d3-9287-234833464d60 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:20.039457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1184/2374] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:01:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:01:20.113047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fcd1adb817477185c218619d4dcf9a', 'request_id': 'req-015ea738-b663-4e04-9e0b-2bc0bf98e509'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:20.131071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fcd1adb817477185c218619d4dcf9a', 'request_id': 'req-015ea738-b663-4e04-9e0b-2bc0bf98e509'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:20.164643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fcd1adb817477185c218619d4dcf9a', 'request_id': 'req-015ea738-b663-4e04-9e0b-2bc0bf98e509'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:20.237460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] The token cache is being invalidate because project 86fcd1adb817477185c218619d4dcf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:20.237767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:20.240962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:20.243120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1191/2375] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:19 2022] DELETE /identity/v3/projects/86fcd1adb817477185c218619d4dcf9a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:20.248021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637249b8-fb16-4ebc-8cb6-948f8569755b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:20.248323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637249b8-fb16-4ebc-8cb6-948f8569755b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:20.248616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637249b8-fb16-4ebc-8cb6-948f8569755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:20.301463 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-637249b8-fb16-4ebc-8cb6-948f8569755b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:20.308237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-637249b8-fb16-4ebc-8cb6-948f8569755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:20.544253 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:20.546196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:20.607915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:20.626972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1185/2376] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:20.635836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699dc0-4a21-4a6c-97e9-485e4c985162 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:20.636312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699dc0-4a21-4a6c-97e9-485e4c985162 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:20.636936 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699dc0-4a21-4a6c-97e9-485e4c985162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:20.678849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-45699dc0-4a21-4a6c-97e9-485e4c985162 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:20.680243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-45699dc0-4a21-4a6c-97e9-485e4c985162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:20.707361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1186/2377] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:20.709824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699dc0-4a21-4a6c-97e9-485e4c985162 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:20.726561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699dc0-4a21-4a6c-97e9-485e4c985162 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:20.757339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f27ac-cb5d-4793-9091-a69eb54adb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:20.758661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f27ac-cb5d-4793-9091-a69eb54adb67 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:20.758994 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f27ac-cb5d-4793-9091-a69eb54adb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:20.764671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f27ac-cb5d-4793-9091-a69eb54adb67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:20.769621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f27ac-cb5d-4793-9091-a69eb54adb67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:01:20.770011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f27ac-cb5d-4793-9091-a69eb54adb67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:20.773799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f27ac-cb5d-4793-9091-a69eb54adb67 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:20.790451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ea738-b663-4e04-9e0b-2bc0bf98e509 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:20.805821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:20.806969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:20.807609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:20.808090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] PATH_INFO: `/v3/projects/edf616fb00fb42ae969d32fccac34e23` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:20.809630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf616fb00fb42ae969d32fccac34e23)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:20.811969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:20.812277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1187/2378] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:01:20.820374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f27ac-cb5d-4793-9091-a69eb54adb67 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:20.842937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f27ac-cb5d-4793-9091-a69eb54adb67 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:20.858003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57bccf-5597-42ec-afc9-8e0730a4be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:20.858504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57bccf-5597-42ec-afc9-8e0730a4be5d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:20.858797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57bccf-5597-42ec-afc9-8e0730a4be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:20.859152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57bccf-5597-42ec-afc9-8e0730a4be5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:20.860177 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57bccf-5597-42ec-afc9-8e0730a4be5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:20.867995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57bccf-5597-42ec-afc9-8e0730a4be5d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:20.903028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:20.947455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf616fb00fb42ae969d32fccac34e23', 'request_id': 'req-28e09c57-6d95-4aef-a8fb-5a84df4cc064'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:20.957334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf616fb00fb42ae969d32fccac34e23', 'request_id': 'req-28e09c57-6d95-4aef-a8fb-5a84df4cc064'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:20.963430 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1188/2379] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:20 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:20.965284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57bccf-5597-42ec-afc9-8e0730a4be5d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:20.981255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf616fb00fb42ae969d32fccac34e23', 'request_id': 'req-28e09c57-6d95-4aef-a8fb-5a84df4cc064'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:21.027353 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] The token cache is being invalidate because project edf616fb00fb42ae969d32fccac34e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:21.027667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:21.029825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-28e09c57-6d95-4aef-a8fb-5a84df4cc064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:21.037782 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1192/2380] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:20 2022] DELETE /identity/v3/projects/edf616fb00fb42ae969d32fccac34e23 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:21.039499 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bb338-f43a-4941-aa04-e2613305e5ab None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:21.039700 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bb338-f43a-4941-aa04-e2613305e5ab None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:21.039984 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bb338-f43a-4941-aa04-e2613305e5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:21.078755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-868bb338-f43a-4941-aa04-e2613305e5ab None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:21.081403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-868bb338-f43a-4941-aa04-e2613305e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:21.141873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57bccf-5597-42ec-afc9-8e0730a4be5d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:21.155869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bb80e-5208-4a37-926b-46a3f9a632cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:21.157842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb80e-5208-4a37-926b-46a3f9a632cc admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:21.158319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb80e-5208-4a37-926b-46a3f9a632cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:21.158841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb80e-5208-4a37-926b-46a3f9a632cc admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:21.160929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bb80e-5208-4a37-926b-46a3f9a632cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:21.167236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bb80e-5208-4a37-926b-46a3f9a632cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:21.215138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1193/2381] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jun 21 16:01:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:21.216306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bb338-f43a-4941-aa04-e2613305e5ab None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:21.218238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-868bb338-f43a-4941-aa04-e2613305e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:21.236339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1189/2382] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:20 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:21.238109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bb338-f43a-4941-aa04-e2613305e5ab None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:21.241097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bb80e-5208-4a37-926b-46a3f9a632cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:21.243355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fc3bb80e-5208-4a37-926b-46a3f9a632cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:21.249295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:21.250303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:21.250582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:21.251292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] PATH_INFO: `/v3/users/4de2d24db9b347d599789d5bfa2858f0` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:21.253066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de2d24db9b347d599789d5bfa2858f0)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:21.256514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:21.259310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bb80e-5208-4a37-926b-46a3f9a632cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:21.272426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbe073-42cc-49bf-be43-13dac9fc5a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:21.273168 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbe073-42cc-49bf-be43-13dac9fc5a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:21.273520 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbe073-42cc-49bf-be43-13dac9fc5a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:21.273771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbe073-42cc-49bf-be43-13dac9fc5a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:21.274491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbe073-42cc-49bf-be43-13dac9fc5a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:21.276226 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbe073-42cc-49bf-be43-13dac9fc5a61 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:21.296097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1190/2383] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:01:21.296097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbe073-42cc-49bf-be43-13dac9fc5a61 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:21.297675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8fdbe073-42cc-49bf-be43-13dac9fc5a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:21.348445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de2d24db9b347d599789d5bfa2858f0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:21.372952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de2d24db9b347d599789d5bfa2858f0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:21.374595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de2d24db9b347d599789d5bfa2858f0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:21.385742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de2d24db9b347d599789d5bfa2858f0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:21.387072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de2d24db9b347d599789d5bfa2858f0'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:21.411652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1194/2384] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:21 2022] DELETE /identity/v3/users/4de2d24db9b347d599789d5bfa2858f0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:21.412878 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:21.416622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:21.452389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbe073-42cc-49bf-be43-13dac9fc5a61 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:21.505907 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:21.514571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:21.576372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae4baf-daf5-48a3-9d22-642e3fc05185 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:21.585371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df0985-1b3c-4841-abdc-f0bfa3f3f3fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:21.588749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df0985-1b3c-4841-abdc-f0bfa3f3f3fe service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:21.590829 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2318ab-bdf5-4628-8bd2-be3091622ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:21.591384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df0985-1b3c-4841-abdc-f0bfa3f3f3fe service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:21.591782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df0985-1b3c-4841-abdc-f0bfa3f3f3fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:21.593243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2318ab-bdf5-4628-8bd2-be3091622ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:21.594408 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2318ab-bdf5-4628-8bd2-be3091622ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:21.596141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2318ab-bdf5-4628-8bd2-be3091622ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:21.598636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2318ab-bdf5-4628-8bd2-be3091622ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:21.599450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d2df0985-1b3c-4841-abdc-f0bfa3f3f3fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:21.604197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2318ab-bdf5-4628-8bd2-be3091622ac6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:21.623048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1195/2385] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:21.624560 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2318ab-bdf5-4628-8bd2-be3091622ac6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:21.645871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2318ab-bdf5-4628-8bd2-be3091622ac6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:21.658071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ab46f-a8e9-4f6c-83f2-31e25265027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:21.661946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ab46f-a8e9-4f6c-83f2-31e25265027d admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:21.662839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ab46f-a8e9-4f6c-83f2-31e25265027d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:21.664022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ab46f-a8e9-4f6c-83f2-31e25265027d admin admin] PATH_INFO: `/v3/projects/1d8cdb6718a1425581dda175b2ac81f7/users/9cc036df0c1541968f9a9f097c8d263a/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:21.715250 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ab46f-a8e9-4f6c-83f2-31e25265027d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8cdb6718a1425581dda175b2ac81f7, user_id=9cc036df0c1541968f9a9f097c8d263a, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:21.719444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ab46f-a8e9-4f6c-83f2-31e25265027d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:21.756826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df0985-1b3c-4841-abdc-f0bfa3f3f3fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:21.758786 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1196/2386] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:21 2022] PUT /identity/v3/projects/1d8cdb6718a1425581dda175b2ac81f7/users/9cc036df0c1541968f9a9f097c8d263a/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:21.761735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df0985-1b3c-4841-abdc-f0bfa3f3f3fe service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:21.770121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171df9e7-1cbe-4083-98f7-fddcf561201c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:21.771274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171df9e7-1cbe-4083-98f7-fddcf561201c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:21.771665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171df9e7-1cbe-4083-98f7-fddcf561201c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:21.822615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-171df9e7-1cbe-4083-98f7-fddcf561201c None None] MFA Rules not processed for user `9cc036df0c1541968f9a9f097c8d263a`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:21.825107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-171df9e7-1cbe-4083-98f7-fddcf561201c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:21.847384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1191/2387] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:01:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:01:21.955304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1197/2388] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:21.960243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df0985-1b3c-4841-abdc-f0bfa3f3f3fe service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:22.013827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df0985-1b3c-4841-abdc-f0bfa3f3f3fe service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:22.050067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872473f-632b-4740-9233-d7ac5ded7f75 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:22.053923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872473f-632b-4740-9233-d7ac5ded7f75 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:22.054612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872473f-632b-4740-9233-d7ac5ded7f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:22.079196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4872473f-632b-4740-9233-d7ac5ded7f75 None None] MFA Rules not processed for user `96c9297b1a444ab189d73da643625270`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:22.081581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4872473f-632b-4740-9233-d7ac5ded7f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:22.192435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1198/2389] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:22.198414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872473f-632b-4740-9233-d7ac5ded7f75 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:22.198414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4872473f-632b-4740-9233-d7ac5ded7f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:22.277534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e549b-4d3c-4995-884b-291a7e1388fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:22.279962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e549b-4d3c-4995-884b-291a7e1388fb admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:22.283942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e549b-4d3c-4995-884b-291a7e1388fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:22.284799 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e549b-4d3c-4995-884b-291a7e1388fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:22.288043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e549b-4d3c-4995-884b-291a7e1388fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:22.292636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e549b-4d3c-4995-884b-291a7e1388fb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:22.373457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1192/2390] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:21 2022] POST /identity/v3/projects => generated 375 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:22.374703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e549b-4d3c-4995-884b-291a7e1388fb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:22.379420 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:22.423567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872473f-632b-4740-9233-d7ac5ded7f75 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:22.540125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e549b-4d3c-4995-884b-291a7e1388fb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:22.564900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1644-c51b-4cfe-84dd-0396f4e95132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:22.565753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1644-c51b-4cfe-84dd-0396f4e95132 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:22.565753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1644-c51b-4cfe-84dd-0396f4e95132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:22.566953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1644-c51b-4cfe-84dd-0396f4e95132 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:22.567070 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c1644-c51b-4cfe-84dd-0396f4e95132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:22.572319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c1644-c51b-4cfe-84dd-0396f4e95132 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:22.574267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:22.575502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:22.575911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:22.576400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] PATH_INFO: `/v3/projects/56d874ee468248fa891d513cf67a260e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:22.578281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d874ee468248fa891d513cf67a260e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:22.581978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:22.626822 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:22.672071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1193/2391] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:22 2022] POST /identity/v3/users => generated 294 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:22.683305 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1644-c51b-4cfe-84dd-0396f4e95132 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:22.730551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1644-c51b-4cfe-84dd-0396f4e95132 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:22.745076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d874ee468248fa891d513cf67a260e', 'request_id': 'req-7ed97014-7876-4038-89b5-a6e5fe630efc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:22.761577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d874ee468248fa891d513cf67a260e', 'request_id': 'req-7ed97014-7876-4038-89b5-a6e5fe630efc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:22.782826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d874ee468248fa891d513cf67a260e', 'request_id': 'req-7ed97014-7876-4038-89b5-a6e5fe630efc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:22.835742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] The token cache is being invalidate because project 56d874ee468248fa891d513cf67a260e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:22.836669 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:22.838531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:22.845274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1199/2392] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:22 2022] DELETE /identity/v3/projects/56d874ee468248fa891d513cf67a260e => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:22.854893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:22.858131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:22.942468 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946636fe-ca93-4ca1-8aff-815af9864556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:22.950079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946636fe-ca93-4ca1-8aff-815af9864556 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:22.950773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946636fe-ca93-4ca1-8aff-815af9864556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:22.951469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946636fe-ca93-4ca1-8aff-815af9864556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:22.954141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946636fe-ca93-4ca1-8aff-815af9864556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:22.959392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946636fe-ca93-4ca1-8aff-815af9864556 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:22.994492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1194/2393] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:22.999290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946636fe-ca93-4ca1-8aff-815af9864556 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:23.002406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-946636fe-ca93-4ca1-8aff-815af9864556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:23.030275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed97014-7876-4038-89b5-a6e5fe630efc admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:23.033240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946636fe-ca93-4ca1-8aff-815af9864556 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:23.040691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:23.041862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:23.042408 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:23.043047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] PATH_INFO: `/v3/users/0017ef5af8e1434dad7763709a319545` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:23.044620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0017ef5af8e1434dad7763709a319545)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:23.046854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:23.047516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc677fa-5cbe-4aab-a936-3f2b353281b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:23.057431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc677fa-5cbe-4aab-a936-3f2b353281b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:23.058104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc677fa-5cbe-4aab-a936-3f2b353281b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:23.058578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc677fa-5cbe-4aab-a936-3f2b353281b8 admin admin] PATH_INFO: `/v3/projects/f4bd047fe0064d338992c598f836489d/users/3111dd9d92e24cfd8b7dc819f4711a5f/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:23.093924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:23.097680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc677fa-5cbe-4aab-a936-3f2b353281b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4bd047fe0064d338992c598f836489d, user_id=3111dd9d92e24cfd8b7dc819f4711a5f, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:23.105735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc677fa-5cbe-4aab-a936-3f2b353281b8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:23.137678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1195/2394] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:22 2022] PUT /identity/v3/projects/f4bd047fe0064d338992c598f836489d/users/3111dd9d92e24cfd8b7dc819f4711a5f/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:23.142498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc677fa-5cbe-4aab-a936-3f2b353281b8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:23.151614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0017ef5af8e1434dad7763709a319545'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:23.188155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0017ef5af8e1434dad7763709a319545'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:23.192000 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0017ef5af8e1434dad7763709a319545'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:23.214913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0017ef5af8e1434dad7763709a319545'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:23.216267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0017ef5af8e1434dad7763709a319545'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:23.250880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc677fa-5cbe-4aab-a936-3f2b353281b8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:23.251793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1200/2395] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:22 2022] DELETE /identity/v3/users/0017ef5af8e1434dad7763709a319545 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:23.378396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b18ff-1a3f-4deb-a9bb-4b117774f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:23.380287 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b18ff-1a3f-4deb-a9bb-4b117774f848 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:23.381050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b18ff-1a3f-4deb-a9bb-4b117774f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:23.381756 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b18ff-1a3f-4deb-a9bb-4b117774f848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:23.386301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b18ff-1a3f-4deb-a9bb-4b117774f848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:23.387978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b18ff-1a3f-4deb-a9bb-4b117774f848 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:23.414909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1196/2396] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:23.423496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:23.426702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:23.459590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcda0d3-66f4-470b-bc30-83f61e10af3f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:23.470344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230931b4-4caa-4558-873e-ddee38c3e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:23.471392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230931b4-4caa-4558-873e-ddee38c3e74b admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:23.471708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230931b4-4caa-4558-873e-ddee38c3e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:23.472123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230931b4-4caa-4558-873e-ddee38c3e74b admin admin] PATH_INFO: `/v3/projects/f4bd047fe0064d338992c598f836489d/users/3111dd9d92e24cfd8b7dc819f4711a5f/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:23.474705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230931b4-4caa-4558-873e-ddee38c3e74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4bd047fe0064d338992c598f836489d, user_id=3111dd9d92e24cfd8b7dc819f4711a5f, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:23.477889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230931b4-4caa-4558-873e-ddee38c3e74b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:23.507734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1201/2397] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:23 2022] PUT /identity/v3/projects/f4bd047fe0064d338992c598f836489d/users/3111dd9d92e24cfd8b7dc819f4711a5f/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:23.511491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d827-005c-4bd8-91f4-fa0925785dc7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:23.511794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d827-005c-4bd8-91f4-fa0925785dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:23.512084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d827-005c-4bd8-91f4-fa0925785dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:23.527947 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:23.625334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-21f2d827-005c-4bd8-91f4-fa0925785dc7 None None] MFA Rules not processed for user `3111dd9d92e24cfd8b7dc819f4711a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:23.631416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21f2d827-005c-4bd8-91f4-fa0925785dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:23.943627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1197/2398] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:24.003589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230931b4-4caa-4558-873e-ddee38c3e74b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:24.008194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-230931b4-4caa-4558-873e-ddee38c3e74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:24.116482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d827-005c-4bd8-91f4-fa0925785dc7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:24.118665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21f2d827-005c-4bd8-91f4-fa0925785dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:24.232720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230931b4-4caa-4558-873e-ddee38c3e74b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:24.245683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d5570-d40e-4656-b3c1-faed1623f7c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:24.248119 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d5570-d40e-4656-b3c1-faed1623f7c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:24.249122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d5570-d40e-4656-b3c1-faed1623f7c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:24.249886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d5570-d40e-4656-b3c1-faed1623f7c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:24.255421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d37d5570-d40e-4656-b3c1-faed1623f7c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:24.272317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d827-005c-4bd8-91f4-fa0925785dc7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:24.277581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:24.278840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:24.279309 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:24.279752 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] PATH_INFO: `/v3/projects/4962caec7c2b4700afbe2eac3e38337d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:24.281545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4962caec7c2b4700afbe2eac3e38337d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:24.284546 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:24.390893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4962caec7c2b4700afbe2eac3e38337d', 'request_id': 'req-cd5fae9c-461a-41a2-a49c-d050306facfe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:24.401722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4962caec7c2b4700afbe2eac3e38337d', 'request_id': 'req-cd5fae9c-461a-41a2-a49c-d050306facfe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:24.408530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4962caec7c2b4700afbe2eac3e38337d', 'request_id': 'req-cd5fae9c-461a-41a2-a49c-d050306facfe'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:24.435137 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] The token cache is being invalidate because project 4962caec7c2b4700afbe2eac3e38337d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:24.435935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:24.437311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd5fae9c-461a-41a2-a49c-d050306facfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:24.444709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1198/2399] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:24 2022] DELETE /identity/v3/projects/4962caec7c2b4700afbe2eac3e38337d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:24.449865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060582-7238-4c19-9be0-5fd1011b6497 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:24.450153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060582-7238-4c19-9be0-5fd1011b6497 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:24.450433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060582-7238-4c19-9be0-5fd1011b6497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:24.454342 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d5570-d40e-4656-b3c1-faed1623f7c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:24.456789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d5570-d40e-4656-b3c1-faed1623f7c5 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:24.492447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1202/2400] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:24.509385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-eb060582-7238-4c19-9be0-5fd1011b6497 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:24.511676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eb060582-7238-4c19-9be0-5fd1011b6497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:24.537972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:24.685283 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1199/2401] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:24.690403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44200b4-1dc4-49b9-9f7b-654c37d44186 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:24.691070 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44200b4-1dc4-49b9-9f7b-654c37d44186 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:24.692153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44200b4-1dc4-49b9-9f7b-654c37d44186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:24.760645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a44200b4-1dc4-49b9-9f7b-654c37d44186 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:24.762548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a44200b4-1dc4-49b9-9f7b-654c37d44186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:24.783914 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1203/2402] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:24.789670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb060582-7238-4c19-9be0-5fd1011b6497 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:24.806611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb060582-7238-4c19-9be0-5fd1011b6497 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:24.817039 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b8de0-1fd5-4199-b882-9199b11be5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:24.818675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b8de0-1fd5-4199-b882-9199b11be5ad admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:24.819812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b8de0-1fd5-4199-b882-9199b11be5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:24.820218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b8de0-1fd5-4199-b882-9199b11be5ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:24.821357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b8de0-1fd5-4199-b882-9199b11be5ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:01:24.821784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b8de0-1fd5-4199-b882-9199b11be5ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:24.824108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b8de0-1fd5-4199-b882-9199b11be5ad admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:24.883996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1200/2403] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:01:24.890081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44200b4-1dc4-49b9-9f7b-654c37d44186 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:24.904303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44200b4-1dc4-49b9-9f7b-654c37d44186 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:24.920190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b9ef-f3ce-48cc-a662-6c0abd806432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:24.921156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b9ef-f3ce-48cc-a662-6c0abd806432 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:24.921599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b9ef-f3ce-48cc-a662-6c0abd806432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:24.922178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b9ef-f3ce-48cc-a662-6c0abd806432 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:24.923254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b9ef-f3ce-48cc-a662-6c0abd806432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:24.925600 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b9ef-f3ce-48cc-a662-6c0abd806432 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:24.988537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b8de0-1fd5-4199-b882-9199b11be5ad admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:24.990783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1204/2404] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:24 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:25.023206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b8de0-1fd5-4199-b882-9199b11be5ad admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:25.265068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032c91-887f-4866-8a3c-d254a75c0649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:25.266852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032c91-887f-4866-8a3c-d254a75c0649 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:25.267610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032c91-887f-4866-8a3c-d254a75c0649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:25.268325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5032c91-887f-4866-8a3c-d254a75c0649 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:25.269874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5032c91-887f-4866-8a3c-d254a75c0649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:25.280032 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5032c91-887f-4866-8a3c-d254a75c0649 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:25.343251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1201/2405] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:24 2022] POST /identity/v3/users => generated 286 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:25.349283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b9ef-f3ce-48cc-a662-6c0abd806432 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:25.368018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b9ef-f3ce-48cc-a662-6c0abd806432 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:25.375337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe00697-4cdc-4780-8414-8c409b0e56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:25.376281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe00697-4cdc-4780-8414-8c409b0e56e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:25.376674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe00697-4cdc-4780-8414-8c409b0e56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:25.377102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe00697-4cdc-4780-8414-8c409b0e56e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:25.378037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe00697-4cdc-4780-8414-8c409b0e56e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:25.381828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe00697-4cdc-4780-8414-8c409b0e56e4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:25.400887 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1205/2406] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:25.402814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032c91-887f-4866-8a3c-d254a75c0649 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:25.425549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5032c91-887f-4866-8a3c-d254a75c0649 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:25.440935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c03393-6bc0-4ba1-9ee5-1341ad58c262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:25.443674 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c03393-6bc0-4ba1-9ee5-1341ad58c262 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:25.444468 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c03393-6bc0-4ba1-9ee5-1341ad58c262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:25.444990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c03393-6bc0-4ba1-9ee5-1341ad58c262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:25.446479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c03393-6bc0-4ba1-9ee5-1341ad58c262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:25.450824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c03393-6bc0-4ba1-9ee5-1341ad58c262 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:25.479588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1202/2407] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:01:25.484196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe00697-4cdc-4780-8414-8c409b0e56e4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:25.490648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:25.503246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe00697-4cdc-4780-8414-8c409b0e56e4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:25.516036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1256081-ff7e-46d8-b9b4-c4a47c49c2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:25.517281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1256081-ff7e-46d8-b9b4-c4a47c49c2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:25.517429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1256081-ff7e-46d8-b9b4-c4a47c49c2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:25.517721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1256081-ff7e-46d8-b9b4-c4a47c49c2fc admin admin] PATH_INFO: `/v3/projects/b651985906b84f249646979a28c757a2/users/cd650abafe754be1bdee17091b8b262c/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:25.560559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1256081-ff7e-46d8-b9b4-c4a47c49c2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b651985906b84f249646979a28c757a2, user_id=cd650abafe754be1bdee17091b8b262c, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:25.564215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1256081-ff7e-46d8-b9b4-c4a47c49c2fc admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:25.589121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1206/2408] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:25 2022] PUT /identity/v3/projects/b651985906b84f249646979a28c757a2/users/cd650abafe754be1bdee17091b8b262c/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:25.601741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c42b20-f89d-4d73-abda-24b89cabb3c9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:25.602247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c42b20-f89d-4d73-abda-24b89cabb3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:25.602776 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c42b20-f89d-4d73-abda-24b89cabb3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:25.685090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-29c42b20-f89d-4d73-abda-24b89cabb3c9 None None] MFA Rules not processed for user `cd650abafe754be1bdee17091b8b262c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:25.688199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-29c42b20-f89d-4d73-abda-24b89cabb3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:25.883457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1203/2409] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:25.899091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1256081-ff7e-46d8-b9b4-c4a47c49c2fc admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:25.902193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a1256081-ff7e-46d8-b9b4-c4a47c49c2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:26.057122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1256081-ff7e-46d8-b9b4-c4a47c49c2fc admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:26.065082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd7763-aabd-40ac-abd7-9e4aa95bf62a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61565364dbac41cfac76195c0be88771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:26.066076 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd7763-aabd-40ac-abd7-9e4aa95bf62a service glance] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:26.066940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd7763-aabd-40ac-abd7-9e4aa95bf62a service glance] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:26.067665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd7763-aabd-40ac-abd7-9e4aa95bf62a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:26.086370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd7763-aabd-40ac-abd7-9e4aa95bf62a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:26.089574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd7763-aabd-40ac-abd7-9e4aa95bf62a service glance] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:26.122061 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1207/2410] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:01:26.344783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c42b20-f89d-4d73-abda-24b89cabb3c9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:26.348176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-29c42b20-f89d-4d73-abda-24b89cabb3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:26.410620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:26.511274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c42b20-f89d-4d73-abda-24b89cabb3c9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:26.519458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:26.521425 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:26.521856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:26.522232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] PATH_INFO: `/v3/users/08cfd881189340ac9d32fee702baf5c6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:26.525215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08cfd881189340ac9d32fee702baf5c6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:26.528120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:26.650876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08cfd881189340ac9d32fee702baf5c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:26.676979 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08cfd881189340ac9d32fee702baf5c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:26.709984 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08cfd881189340ac9d32fee702baf5c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:26.713363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08cfd881189340ac9d32fee702baf5c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:26.737357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08cfd881189340ac9d32fee702baf5c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:26.752490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1204/2411] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:26 2022] DELETE /identity/v3/users/08cfd881189340ac9d32fee702baf5c6 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:26.760605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eae0fa-2a2a-46ed-ad50-f3bf91777b75 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:26.761183 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eae0fa-2a2a-46ed-ad50-f3bf91777b75 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:26.761640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eae0fa-2a2a-46ed-ad50-f3bf91777b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:26.839679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-18eae0fa-2a2a-46ed-ad50-f3bf91777b75 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:26.843952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-18eae0fa-2a2a-46ed-ad50-f3bf91777b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:27.075266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1208/2412] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:27.133423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:27.135278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:27.340972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42311246-a379-4f40-a756-e6b89c284972 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:27.352268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27117037-efe6-4be6-a605-120eb6b8fb19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:27.353794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117037-efe6-4be6-a605-120eb6b8fb19 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:27.354396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117037-efe6-4be6-a605-120eb6b8fb19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:27.355009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27117037-efe6-4be6-a605-120eb6b8fb19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:27.388434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27117037-efe6-4be6-a605-120eb6b8fb19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:27.392690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27117037-efe6-4be6-a605-120eb6b8fb19 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:27.417846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1205/2413] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:27.900039 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eae0fa-2a2a-46ed-ad50-f3bf91777b75 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:27.902859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-18eae0fa-2a2a-46ed-ad50-f3bf91777b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:27.960969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eae0fa-2a2a-46ed-ad50-f3bf91777b75 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:27.968728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:27.970049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:27.970661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:27.971194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] PATH_INFO: `/v3/projects/8ed8d7d52654430eb931fa2044b3eb5e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:27.974145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed8d7d52654430eb931fa2044b3eb5e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:27.977352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:28.114734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed8d7d52654430eb931fa2044b3eb5e', 'request_id': 'req-5915bab6-801e-42a2-92a8-8b8225828305'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:28.128043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed8d7d52654430eb931fa2044b3eb5e', 'request_id': 'req-5915bab6-801e-42a2-92a8-8b8225828305'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:28.143007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed8d7d52654430eb931fa2044b3eb5e', 'request_id': 'req-5915bab6-801e-42a2-92a8-8b8225828305'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:28.163008 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] The token cache is being invalidate because project 8ed8d7d52654430eb931fa2044b3eb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:28.163357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:28.164101 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5915bab6-801e-42a2-92a8-8b8225828305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:28.166185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1209/2414] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:27 2022] DELETE /identity/v3/projects/8ed8d7d52654430eb931fa2044b3eb5e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:28.174286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01410f1e-a83a-445d-9048-ae9edd013a2a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:28.174835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01410f1e-a83a-445d-9048-ae9edd013a2a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:28.175345 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01410f1e-a83a-445d-9048-ae9edd013a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:28.217232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-01410f1e-a83a-445d-9048-ae9edd013a2a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:28.220262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-01410f1e-a83a-445d-9048-ae9edd013a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:28.311198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:28.382610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1206/2415] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:28.395869 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427f1e8-baa9-4acb-b114-4c33d93c7c2b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:28.398975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427f1e8-baa9-4acb-b114-4c33d93c7c2b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:28.399616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427f1e8-baa9-4acb-b114-4c33d93c7c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:28.401677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01410f1e-a83a-445d-9048-ae9edd013a2a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:28.404884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-01410f1e-a83a-445d-9048-ae9edd013a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:28.413508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:28.449110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-3427f1e8-baa9-4acb-b114-4c33d93c7c2b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:28.450930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-3427f1e8-baa9-4acb-b114-4c33d93c7c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:28.462178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01410f1e-a83a-445d-9048-ae9edd013a2a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:28.488173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:28.488352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1210/2416] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:28.488493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:28.488493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:28.488493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] PATH_INFO: `/v3/users/9cc036df0c1541968f9a9f097c8d263a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:28.491819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3154d-8362-4d7a-af48-04898bc978cd None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:28.492123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc036df0c1541968f9a9f097c8d263a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:28.492320 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3154d-8362-4d7a-af48-04898bc978cd None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:28.494570 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:28.497773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3154d-8362-4d7a-af48-04898bc978cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:28.540227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-00e3154d-8362-4d7a-af48-04898bc978cd None None] MFA Rules not processed for user `e1b76ba52fe447a5bbf620076c9140f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:28.541797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-00e3154d-8362-4d7a-af48-04898bc978cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:28.604434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc036df0c1541968f9a9f097c8d263a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:28.655807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc036df0c1541968f9a9f097c8d263a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:28.666893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc036df0c1541968f9a9f097c8d263a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:28.668348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc036df0c1541968f9a9f097c8d263a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:28.684090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc036df0c1541968f9a9f097c8d263a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:28.698627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1207/2417] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:28 2022] DELETE /identity/v3/users/9cc036df0c1541968f9a9f097c8d263a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:28.699840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:28.702453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:28.731421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1211/2418] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:28.734498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9208-eced-4e77-9151-712c786003e1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:28.735806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9208-eced-4e77-9151-712c786003e1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:28.736613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9208-eced-4e77-9151-712c786003e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:28.772568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a07d9208-eced-4e77-9151-712c786003e1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:28.773960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a07d9208-eced-4e77-9151-712c786003e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:28.902212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec34920-be29-4c27-9a9c-a39a34cf4c0c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:28.902774 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1212/2419] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:28.917034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9208-eced-4e77-9151-712c786003e1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:28.918484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a07d9208-eced-4e77-9151-712c786003e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:28.925399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e6627-f683-44e2-9fc6-89c0c89be6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:28.927865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6627-f683-44e2-9fc6-89c0c89be6ed admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:28.928401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6627-f683-44e2-9fc6-89c0c89be6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:28.928925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6627-f683-44e2-9fc6-89c0c89be6ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:28.930774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e6627-f683-44e2-9fc6-89c0c89be6ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:01:28.931295 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e6627-f683-44e2-9fc6-89c0c89be6ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:28.934538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e6627-f683-44e2-9fc6-89c0c89be6ed admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:28.961390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1208/2420] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:01:28.968017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e6627-f683-44e2-9fc6-89c0c89be6ed admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:28.988473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e6627-f683-44e2-9fc6-89c0c89be6ed admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:28.999636 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7456d1-0119-41bc-bb1b-c55916cf1b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:29.001257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7456d1-0119-41bc-bb1b-c55916cf1b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:29.001706 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7456d1-0119-41bc-bb1b-c55916cf1b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:29.002310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7456d1-0119-41bc-bb1b-c55916cf1b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:29.003780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7456d1-0119-41bc-bb1b-c55916cf1b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:29.007330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7456d1-0119-41bc-bb1b-c55916cf1b0c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:29.053450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9208-eced-4e77-9151-712c786003e1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:29.061764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d377e-f6f3-42f5-b915-6ea1eb5913aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:29.062456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d377e-f6f3-42f5-b915-6ea1eb5913aa service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:29.062744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d377e-f6f3-42f5-b915-6ea1eb5913aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:29.063030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d377e-f6f3-42f5-b915-6ea1eb5913aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:29.065905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1209/2421] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:28 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:29.073050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7456d1-0119-41bc-bb1b-c55916cf1b0c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:29.087309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d377e-f6f3-42f5-b915-6ea1eb5913aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:29.090401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d377e-f6f3-42f5-b915-6ea1eb5913aa service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:29.116221 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1213/2422] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:29.133476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:29.192252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7456d1-0119-41bc-bb1b-c55916cf1b0c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:29.203094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2d11e-ca38-42d9-958b-a52952b7e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:29.204384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2d11e-ca38-42d9-958b-a52952b7e8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:29.205232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2d11e-ca38-42d9-958b-a52952b7e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:29.206071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2d11e-ca38-42d9-958b-a52952b7e8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:29.208051 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2d11e-ca38-42d9-958b-a52952b7e8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:29.212128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2d11e-ca38-42d9-958b-a52952b7e8e6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:29.268777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1210/2423] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:29 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:01:29.269531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d377e-f6f3-42f5-b915-6ea1eb5913aa service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:29.302525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d377e-f6f3-42f5-b915-6ea1eb5913aa service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:29.320936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a12496-002f-4195-b2be-f2413a62e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:29.323392 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a12496-002f-4195-b2be-f2413a62e72a admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:29.324569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a12496-002f-4195-b2be-f2413a62e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:29.325398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a12496-002f-4195-b2be-f2413a62e72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:29.327576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a12496-002f-4195-b2be-f2413a62e72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:29.330957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a12496-002f-4195-b2be-f2413a62e72a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:29.354274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1214/2424] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:01:29.360596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2d11e-ca38-42d9-958b-a52952b7e8e6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:29.383637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2d11e-ca38-42d9-958b-a52952b7e8e6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:29.394273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2717fd-37cf-45cf-a354-a8d1d0b33a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:29.397652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2717fd-37cf-45cf-a354-a8d1d0b33a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:29.397652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2717fd-37cf-45cf-a354-a8d1d0b33a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:29.397652 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2717fd-37cf-45cf-a354-a8d1d0b33a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:29.398146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2717fd-37cf-45cf-a354-a8d1d0b33a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:29.403996 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2717fd-37cf-45cf-a354-a8d1d0b33a69 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:29.447101 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a12496-002f-4195-b2be-f2413a62e72a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:29.448232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1211/2425] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:29.465831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a12496-002f-4195-b2be-f2413a62e72a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:29.478143 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f534be-6352-4d9b-a630-fbac74f1cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:29.480422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f534be-6352-4d9b-a630-fbac74f1cfb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:29.481036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f534be-6352-4d9b-a630-fbac74f1cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:29.481799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f534be-6352-4d9b-a630-fbac74f1cfb0 admin admin] PATH_INFO: `/v3/projects/e3053ece51d24388a8b49ad68543419b/users/976e351a35664c858fbe8892327bfb54/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:29.509370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f534be-6352-4d9b-a630-fbac74f1cfb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3053ece51d24388a8b49ad68543419b, user_id=976e351a35664c858fbe8892327bfb54, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:29.515271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f534be-6352-4d9b-a630-fbac74f1cfb0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:29.551849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1215/2426] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:29 2022] PUT /identity/v3/projects/e3053ece51d24388a8b49ad68543419b/users/976e351a35664c858fbe8892327bfb54/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:29.553835 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01817e-ce79-465e-aa9f-83bcb433ff57 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:29.554417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01817e-ce79-465e-aa9f-83bcb433ff57 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:29.554736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01817e-ce79-465e-aa9f-83bcb433ff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:29.597632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ef01817e-ce79-465e-aa9f-83bcb433ff57 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:29.603964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ef01817e-ce79-465e-aa9f-83bcb433ff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:29.665571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f534be-6352-4d9b-a630-fbac74f1cfb0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:29.667581 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-11f534be-6352-4d9b-a630-fbac74f1cfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:29.715015 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:29.730377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1212/2427] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:29.768528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01817e-ce79-465e-aa9f-83bcb433ff57 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:29.838860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f534be-6352-4d9b-a630-fbac74f1cfb0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:29.846803 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:29.849032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:29.849705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:29.849997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] PATH_INFO: `/v3/projects/1d8cdb6718a1425581dda175b2ac81f7` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:29.855882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8cdb6718a1425581dda175b2ac81f7)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:29.858129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:29.905564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01817e-ce79-465e-aa9f-83bcb433ff57 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:29.914609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bb46e-f983-4783-b6cf-fc7b217d173f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:29.916019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bb46e-f983-4783-b6cf-fc7b217d173f service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:29.916933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bb46e-f983-4783-b6cf-fc7b217d173f service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:29.917518 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bb46e-f983-4783-b6cf-fc7b217d173f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:29.963208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bb46e-f983-4783-b6cf-fc7b217d173f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:29.966327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bb46e-f983-4783-b6cf-fc7b217d173f service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:29.997888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8cdb6718a1425581dda175b2ac81f7', 'request_id': 'req-5fe48434-1fce-459a-b601-265f6dde19c3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:29.999718 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1213/2428] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:01:30.016031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8cdb6718a1425581dda175b2ac81f7', 'request_id': 'req-5fe48434-1fce-459a-b601-265f6dde19c3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:30.042596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8cdb6718a1425581dda175b2ac81f7', 'request_id': 'req-5fe48434-1fce-459a-b601-265f6dde19c3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:30.078004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] The token cache is being invalidate because project 1d8cdb6718a1425581dda175b2ac81f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:30.078597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:30.080151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:30.091661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1216/2429] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:29 2022] DELETE /identity/v3/projects/1d8cdb6718a1425581dda175b2ac81f7 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:30.094013 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bb46e-f983-4783-b6cf-fc7b217d173f service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:30.155319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bb46e-f983-4783-b6cf-fc7b217d173f service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:30.289997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:30.350771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:30.355247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:30.355601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:30.355966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] PATH_INFO: `/v3/users/3111dd9d92e24cfd8b7dc819f4711a5f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:30.358108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3111dd9d92e24cfd8b7dc819f4711a5f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:30.361244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:30.500954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3111dd9d92e24cfd8b7dc819f4711a5f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:30.537914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3111dd9d92e24cfd8b7dc819f4711a5f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:30.560403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3111dd9d92e24cfd8b7dc819f4711a5f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:30.561621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3111dd9d92e24cfd8b7dc819f4711a5f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:30.579607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3111dd9d92e24cfd8b7dc819f4711a5f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:30.593332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1214/2430] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:30 2022] DELETE /identity/v3/users/3111dd9d92e24cfd8b7dc819f4711a5f => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:31.269519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:31.272445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:31.303267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe48434-1fce-459a-b601-265f6dde19c3 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:31.510196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:31.512063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:31.528356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:31.532554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:31.534297 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:31.535710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] PATH_INFO: `/v3/users/c40b6e375eca4ce087074b6045913e82` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:31.540108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40b6e375eca4ce087074b6045913e82)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:31.570190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:31.576533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1372ed-1bfe-4b3c-92ba-d7511df96088 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:31.591857 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:31.593850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:31.594793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:31.595832 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] PATH_INFO: `/v3/projects/f4bd047fe0064d338992c598f836489d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:31.599775 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4bd047fe0064d338992c598f836489d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:31.608017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:31.712067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:31.720790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40b6e375eca4ce087074b6045913e82'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:31.735496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4bd047fe0064d338992c598f836489d', 'request_id': 'req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:31.756910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4bd047fe0064d338992c598f836489d', 'request_id': 'req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:31.776033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4bd047fe0064d338992c598f836489d', 'request_id': 'req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:31.777502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40b6e375eca4ce087074b6045913e82'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:31.780165 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40b6e375eca4ce087074b6045913e82'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:31.815199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40b6e375eca4ce087074b6045913e82'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:31.816478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d821b0ba-289e-475c-b15f-2e54bcea0bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40b6e375eca4ce087074b6045913e82'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:31.845361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] The token cache is being invalidate because project f4bd047fe0064d338992c598f836489d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:31.845866 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:31.850466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5939b4f1-dc32-42b6-8791-da31b5dd3fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:31.853639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1217/2431] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:31 2022] DELETE /identity/v3/users/c40b6e375eca4ce087074b6045913e82 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:31.857458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1215/2432] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:31 2022] DELETE /identity/v3/projects/f4bd047fe0064d338992c598f836489d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:01:31.867413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e1a1-67fb-4e71-b538-38efe897e0ce None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:31.868551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e1a1-67fb-4e71-b538-38efe897e0ce None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:31.869317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039e1a1-67fb-4e71-b538-38efe897e0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:31.873889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c1f3-4289-485e-8d96-587f1f052754 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:31.874342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c1f3-4289-485e-8d96-587f1f052754 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:31.874760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c1f3-4289-485e-8d96-587f1f052754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:31.959508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1039e1a1-67fb-4e71-b538-38efe897e0ce None None] MFA Rules not processed for user `976e351a35664c858fbe8892327bfb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:31.967205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1039e1a1-67fb-4e71-b538-38efe897e0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:31.977137 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-42f9c1f3-4289-485e-8d96-587f1f052754 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:31.979490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42f9c1f3-4289-485e-8d96-587f1f052754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:32.050941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:32.086974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1216/2433] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:32.093280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1218/2434] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:32.106654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c1f3-4289-485e-8d96-587f1f052754 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:32.108903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42f9c1f3-4289-485e-8d96-587f1f052754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:32.110867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039e1a1-67fb-4e71-b538-38efe897e0ce None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:32.112993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1039e1a1-67fb-4e71-b538-38efe897e0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:32.205605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c1f3-4289-485e-8d96-587f1f052754 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:32.210676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df556590-ca87-405f-ab51-6cfac059da5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:32.211315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df556590-ca87-405f-ab51-6cfac059da5f service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:32.211606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df556590-ca87-405f-ab51-6cfac059da5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:32.211934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df556590-ca87-405f-ab51-6cfac059da5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:32.216229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039e1a1-67fb-4e71-b538-38efe897e0ce None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:32.220121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564403fc-57de-4845-8949-d1b6d8c4abb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:32.220795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564403fc-57de-4845-8949-d1b6d8c4abb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:32.221089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564403fc-57de-4845-8949-d1b6d8c4abb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:32.221369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564403fc-57de-4845-8949-d1b6d8c4abb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:32.229220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df556590-ca87-405f-ab51-6cfac059da5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:32.232440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df556590-ca87-405f-ab51-6cfac059da5f service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:32.235199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564403fc-57de-4845-8949-d1b6d8c4abb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:32.236696 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564403fc-57de-4845-8949-d1b6d8c4abb6 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:32.245559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1217/2435] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:32.250220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1219/2436] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:01:33.000425 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df556590-ca87-405f-ab51-6cfac059da5f service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:33.003566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-df556590-ca87-405f-ab51-6cfac059da5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:33.029818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df556590-ca87-405f-ab51-6cfac059da5f service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:33.041342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:33.043063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:33.043590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:33.044031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] PATH_INFO: `/v3/projects/ad4cb990658540208e071abdf3e3cf28` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:33.045770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4cb990658540208e071abdf3e3cf28)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:33.048817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:33.151743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4cb990658540208e071abdf3e3cf28', 'request_id': 'req-86f64c7e-7d3f-4278-b79f-ca473ff21b30'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:33.165114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4cb990658540208e071abdf3e3cf28', 'request_id': 'req-86f64c7e-7d3f-4278-b79f-ca473ff21b30'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:33.178050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4cb990658540208e071abdf3e3cf28', 'request_id': 'req-86f64c7e-7d3f-4278-b79f-ca473ff21b30'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:33.204873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] The token cache is being invalidate because project ad4cb990658540208e071abdf3e3cf28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:33.205606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:33.206806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86f64c7e-7d3f-4278-b79f-ca473ff21b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:33.216005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1218/2437] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:32 2022] DELETE /identity/v3/projects/ad4cb990658540208e071abdf3e3cf28 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:33.220283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48333a92-a954-4137-87f6-9ca56d5ef862 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:33.221082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48333a92-a954-4137-87f6-9ca56d5ef862 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:33.221574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48333a92-a954-4137-87f6-9ca56d5ef862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:33.253400 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-48333a92-a954-4137-87f6-9ca56d5ef862 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:33.256138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-48333a92-a954-4137-87f6-9ca56d5ef862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:33.336621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:33.358258 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1220/2438] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:33.367588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917d7f-9d3f-4af2-a34d-a838aa1c70b6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:33.367872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917d7f-9d3f-4af2-a34d-a838aa1c70b6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:33.368159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917d7f-9d3f-4af2-a34d-a838aa1c70b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:33.390726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-89917d7f-9d3f-4af2-a34d-a838aa1c70b6 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:33.392329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-89917d7f-9d3f-4af2-a34d-a838aa1c70b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:33.403567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1219/2439] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:33.408573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48333a92-a954-4137-87f6-9ca56d5ef862 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:33.429042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48333a92-a954-4137-87f6-9ca56d5ef862 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:33.437905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8508d92-0abf-4475-8b11-3c69036b657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:33.439114 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8508d92-0abf-4475-8b11-3c69036b657c admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:33.439674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8508d92-0abf-4475-8b11-3c69036b657c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:33.440188 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8508d92-0abf-4475-8b11-3c69036b657c admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:33.441656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8508d92-0abf-4475-8b11-3c69036b657c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:01:33.443096 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8508d92-0abf-4475-8b11-3c69036b657c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:33.446083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8508d92-0abf-4475-8b11-3c69036b657c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:33.470671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1221/2440] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:01:33.476422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89917d7f-9d3f-4af2-a34d-a838aa1c70b6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:33.487670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89917d7f-9d3f-4af2-a34d-a838aa1c70b6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:33.494031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc70e2-356e-4b99-b334-4164e11d048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:33.494660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc70e2-356e-4b99-b334-4164e11d048e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:33.494982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc70e2-356e-4b99-b334-4164e11d048e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:33.495375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc70e2-356e-4b99-b334-4164e11d048e admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:33.496144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc70e2-356e-4b99-b334-4164e11d048e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:33.498127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc70e2-356e-4b99-b334-4164e11d048e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:33.539456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1220/2441] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:33 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:01:33.540703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8508d92-0abf-4475-8b11-3c69036b657c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:33.556309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8508d92-0abf-4475-8b11-3c69036b657c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:33.649241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711a674-0f28-4580-a25c-b2bc4a86ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:33.650213 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711a674-0f28-4580-a25c-b2bc4a86ecd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:33.650662 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711a674-0f28-4580-a25c-b2bc4a86ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:33.651229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711a674-0f28-4580-a25c-b2bc4a86ecd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:33.652098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711a674-0f28-4580-a25c-b2bc4a86ecd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:33.654674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711a674-0f28-4580-a25c-b2bc4a86ecd7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:33.685717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1222/2442] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:33 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:33.691006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc70e2-356e-4b99-b334-4164e11d048e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:33.709435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc70e2-356e-4b99-b334-4164e11d048e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:33.715655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0c329-e588-4746-9fca-62f188c38ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:33.716789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c329-e588-4746-9fca-62f188c38ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:33.717215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c329-e588-4746-9fca-62f188c38ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:33.717620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c329-e588-4746-9fca-62f188c38ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:33.718628 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0c329-e588-4746-9fca-62f188c38ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:33.721162 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0c329-e588-4746-9fca-62f188c38ae4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:33.740006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1221/2443] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:33.744649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711a674-0f28-4580-a25c-b2bc4a86ecd7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:33.757289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711a674-0f28-4580-a25c-b2bc4a86ecd7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:33.763223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ced6-4470-46a8-9222-0becc8de191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:33.763958 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ced6-4470-46a8-9222-0becc8de191e admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:33.764243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ced6-4470-46a8-9222-0becc8de191e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:33.764557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ced6-4470-46a8-9222-0becc8de191e admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:33.765307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13ced6-4470-46a8-9222-0becc8de191e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:33.767312 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13ced6-4470-46a8-9222-0becc8de191e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:33.781346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1223/2444] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:33.786881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0c329-e588-4746-9fca-62f188c38ae4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:33.803749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0c329-e588-4746-9fca-62f188c38ae4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:33.809699 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81887fee-dd71-4cc9-8f84-f0ea645918dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:33.810710 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81887fee-dd71-4cc9-8f84-f0ea645918dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:33.811002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81887fee-dd71-4cc9-8f84-f0ea645918dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:33.811327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81887fee-dd71-4cc9-8f84-f0ea645918dc admin admin] PATH_INFO: `/v3/projects/aad1011bffba436c9d4c938ab6137c4d/users/3c3dba1352544598a85b900195b64300/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:33.832663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81887fee-dd71-4cc9-8f84-f0ea645918dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad1011bffba436c9d4c938ab6137c4d, user_id=3c3dba1352544598a85b900195b64300, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:33.835682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81887fee-dd71-4cc9-8f84-f0ea645918dc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:33.854646 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1222/2445] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:33 2022] PUT /identity/v3/projects/aad1011bffba436c9d4c938ab6137c4d/users/3c3dba1352544598a85b900195b64300/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:33.860571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b325-e649-4725-b51f-72087e7b9a9a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:33.860943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b325-e649-4725-b51f-72087e7b9a9a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:33.861329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b325-e649-4725-b51f-72087e7b9a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:33.882955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1f13b325-e649-4725-b51f-72087e7b9a9a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:33.884512 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1f13b325-e649-4725-b51f-72087e7b9a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:34.024898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36fb4-5368-4dd7-9f35-947f345b67ce None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:34.026354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36fb4-5368-4dd7-9f35-947f345b67ce None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:34.027108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36fb4-5368-4dd7-9f35-947f345b67ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:34.035465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1224/2446] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:34.050036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b325-e649-4725-b51f-72087e7b9a9a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:34.053445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1f13b325-e649-4725-b51f-72087e7b9a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:34.068292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-65e36fb4-5368-4dd7-9f35-947f345b67ce None None] MFA Rules not processed for user `976e351a35664c858fbe8892327bfb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:34.070143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65e36fb4-5368-4dd7-9f35-947f345b67ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:34.077853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:34.237625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1223/2447] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:34.242991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b325-e649-4725-b51f-72087e7b9a9a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:34.257389 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a3c1-a0fe-4121-9f1f-c5d4e1279a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:34.259524 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a3c1-a0fe-4121-9f1f-c5d4e1279a84 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:34.261124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a3c1-a0fe-4121-9f1f-c5d4e1279a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:34.261956 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a3c1-a0fe-4121-9f1f-c5d4e1279a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:34.283539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966a3c1-a0fe-4121-9f1f-c5d4e1279a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:34.291456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966a3c1-a0fe-4121-9f1f-c5d4e1279a84 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:34.306830 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1225/2448] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:01:40.664729 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915c73-5542-4d24-9dac-9b2edeeb4db7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:40.665205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915c73-5542-4d24-9dac-9b2edeeb4db7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:40.665475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915c73-5542-4d24-9dac-9b2edeeb4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:40.708104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-80915c73-5542-4d24-9dac-9b2edeeb4db7 None None] MFA Rules not processed for user `3c3dba1352544598a85b900195b64300`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:40.710123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-80915c73-5542-4d24-9dac-9b2edeeb4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:40.820207 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1224/2449] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:40.825549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a3c1-a0fe-4121-9f1f-c5d4e1279a84 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:40.835725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:40.846923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a3c1-a0fe-4121-9f1f-c5d4e1279a84 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:40.857362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4463fd6-b54e-4faa-9bba-8cc24fd1761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:40.859295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4463fd6-b54e-4faa-9bba-8cc24fd1761b admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:40.859912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4463fd6-b54e-4faa-9bba-8cc24fd1761b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:40.860300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4463fd6-b54e-4faa-9bba-8cc24fd1761b admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:40.861145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4463fd6-b54e-4faa-9bba-8cc24fd1761b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:40.863531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4463fd6-b54e-4faa-9bba-8cc24fd1761b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:40.913507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1226/2450] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:40 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:01:40.914991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915c73-5542-4d24-9dac-9b2edeeb4db7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:40.930286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915c73-5542-4d24-9dac-9b2edeeb4db7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:41.037157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e72a-3356-4d53-b645-52f6af63fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:41.037656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e72a-3356-4d53-b645-52f6af63fb5c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:41.038038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e72a-3356-4d53-b645-52f6af63fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:41.038513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84e72a-3356-4d53-b645-52f6af63fb5c admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:41.039274 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84e72a-3356-4d53-b645-52f6af63fb5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:41.042569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84e72a-3356-4d53-b645-52f6af63fb5c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:41.071957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1225/2451] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:40 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:01:41.077359 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4463fd6-b54e-4faa-9bba-8cc24fd1761b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:41.092951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4463fd6-b54e-4faa-9bba-8cc24fd1761b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:41.099456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ccf5-b02f-4244-86fa-08faa52d2223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:41.100291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ccf5-b02f-4244-86fa-08faa52d2223 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:41.100582 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ccf5-b02f-4244-86fa-08faa52d2223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:41.100862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ccf5-b02f-4244-86fa-08faa52d2223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:41.101626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ccf5-b02f-4244-86fa-08faa52d2223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:41.103349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ccf5-b02f-4244-86fa-08faa52d2223 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:41.118890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1227/2452] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:41.124045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e72a-3356-4d53-b645-52f6af63fb5c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:41.137089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84e72a-3356-4d53-b645-52f6af63fb5c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:41.142916 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b7d74-fe0f-4ab3-9e1b-c1e61accba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:41.144102 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b7d74-fe0f-4ab3-9e1b-c1e61accba22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:41.144454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b7d74-fe0f-4ab3-9e1b-c1e61accba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:41.145562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b7d74-fe0f-4ab3-9e1b-c1e61accba22 admin admin] PATH_INFO: `/v3/projects/d09f96aaa3254e8f8105636ab20a3b4a/users/e3075db9329140b0a2c6b0c8b5657613/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:41.164878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b7d74-fe0f-4ab3-9e1b-c1e61accba22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09f96aaa3254e8f8105636ab20a3b4a, user_id=e3075db9329140b0a2c6b0c8b5657613, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:41.167648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b7d74-fe0f-4ab3-9e1b-c1e61accba22 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:41.183424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1226/2453] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:41 2022] PUT /identity/v3/projects/d09f96aaa3254e8f8105636ab20a3b4a/users/e3075db9329140b0a2c6b0c8b5657613/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:01:41.187741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ccf5-b02f-4244-86fa-08faa52d2223 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:41.198793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ccf5-b02f-4244-86fa-08faa52d2223 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:41.295513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d758747-c8ce-4ba2-ab5b-000ddeefc428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:41.296358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758747-c8ce-4ba2-ab5b-000ddeefc428 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:41.296716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758747-c8ce-4ba2-ab5b-000ddeefc428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:41.297071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758747-c8ce-4ba2-ab5b-000ddeefc428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:41.297903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d758747-c8ce-4ba2-ab5b-000ddeefc428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:41.299705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d758747-c8ce-4ba2-ab5b-000ddeefc428 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:41.333060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1228/2454] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:01:41.340228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b7d74-fe0f-4ab3-9e1b-c1e61accba22 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:41.357339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b7d74-fe0f-4ab3-9e1b-c1e61accba22 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:41.362503 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9db07-680e-49b1-8a84-365f3fcbb50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:41.364147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9db07-680e-49b1-8a84-365f3fcbb50a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:41.364428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9db07-680e-49b1-8a84-365f3fcbb50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:41.364708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9db07-680e-49b1-8a84-365f3fcbb50a admin admin] PATH_INFO: `/v3/projects/d09f96aaa3254e8f8105636ab20a3b4a/users/e3075db9329140b0a2c6b0c8b5657613/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:41.366866 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9db07-680e-49b1-8a84-365f3fcbb50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09f96aaa3254e8f8105636ab20a3b4a, user_id=e3075db9329140b0a2c6b0c8b5657613, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:41.369666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9db07-680e-49b1-8a84-365f3fcbb50a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:41.374017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:41.400035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1227/2455] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:41 2022] PUT /identity/v3/projects/d09f96aaa3254e8f8105636ab20a3b4a/users/e3075db9329140b0a2c6b0c8b5657613/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:49.150609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d758747-c8ce-4ba2-ab5b-000ddeefc428 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:49.153789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5d758747-c8ce-4ba2-ab5b-000ddeefc428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:49.236572 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d758747-c8ce-4ba2-ab5b-000ddeefc428 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:49.452091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:49.453021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:49.453310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:49.453588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] PATH_INFO: `/v3/users/9644a3dbddfd49caaeb2c3421886f85b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:49.454939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9644a3dbddfd49caaeb2c3421886f85b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:49.457982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:49.543657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9644a3dbddfd49caaeb2c3421886f85b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:49.576027 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9644a3dbddfd49caaeb2c3421886f85b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:49.577703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9644a3dbddfd49caaeb2c3421886f85b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:49.582078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:49.601809 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9644a3dbddfd49caaeb2c3421886f85b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:49.602846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9644a3dbddfd49caaeb2c3421886f85b'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:49.634054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1229/2456] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:01:49 2022] DELETE /identity/v3/users/9644a3dbddfd49caaeb2c3421886f85b => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:01:49.639020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52e7f2-1d3c-4dc3-90c2-e225dc4a5cc8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:49.639876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52e7f2-1d3c-4dc3-90c2-e225dc4a5cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:49.639876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52e7f2-1d3c-4dc3-90c2-e225dc4a5cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:49.673325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fe52e7f2-1d3c-4dc3-90c2-e225dc4a5cc8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:49.676038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fe52e7f2-1d3c-4dc3-90c2-e225dc4a5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:49.856330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1228/2457] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:49.886236 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:49.889504 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:50.059899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7c43c-5638-4800-8873-810385b3402c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:50.068663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdaf31-5f6c-4f4c-a9ad-3f7e6e77a71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:50.072583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdaf31-5f6c-4f4c-a9ad-3f7e6e77a71f service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:50.073192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdaf31-5f6c-4f4c-a9ad-3f7e6e77a71f service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:50.074005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdaf31-5f6c-4f4c-a9ad-3f7e6e77a71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:50.104288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdaf31-5f6c-4f4c-a9ad-3f7e6e77a71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:50.118697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdaf31-5f6c-4f4c-a9ad-3f7e6e77a71f service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:50.143733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1230/2458] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:51.494953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52e7f2-1d3c-4dc3-90c2-e225dc4a5cc8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:51.498418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fe52e7f2-1d3c-4dc3-90c2-e225dc4a5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:51.530809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52e7f2-1d3c-4dc3-90c2-e225dc4a5cc8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:51.542346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:51.544303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:51.545067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:51.545803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] PATH_INFO: `/v3/projects/42d43da7829a400fa58e6155346be5eb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:51.548578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d43da7829a400fa58e6155346be5eb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:51.553917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:51.677160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d43da7829a400fa58e6155346be5eb', 'request_id': 'req-aaad55a4-1537-4e93-a03c-351d032b8f55'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:51.694976 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d43da7829a400fa58e6155346be5eb', 'request_id': 'req-aaad55a4-1537-4e93-a03c-351d032b8f55'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:51.708733 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d43da7829a400fa58e6155346be5eb', 'request_id': 'req-aaad55a4-1537-4e93-a03c-351d032b8f55'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:51.736948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] The token cache is being invalidate because project 42d43da7829a400fa58e6155346be5eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:01:51.740124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:51.742350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaad55a4-1537-4e93-a03c-351d032b8f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:01:51.746138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1229/2459] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:01:51 2022] DELETE /identity/v3/projects/42d43da7829a400fa58e6155346be5eb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:51.755198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494fb7f-e66b-41d5-a533-830cf95f38ac None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:51.756120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494fb7f-e66b-41d5-a533-830cf95f38ac None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:51.756725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494fb7f-e66b-41d5-a533-830cf95f38ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:51.795912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a494fb7f-e66b-41d5-a533-830cf95f38ac None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:51.799510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a494fb7f-e66b-41d5-a533-830cf95f38ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:51.981702 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1231/2460] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:51.984529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054a12-de04-4fad-a9c5-d4c80fb6ef43 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:51.984832 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054a12-de04-4fad-a9c5-d4c80fb6ef43 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:51.985128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03054a12-de04-4fad-a9c5-d4c80fb6ef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:52.013974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-03054a12-de04-4fad-a9c5-d4c80fb6ef43 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:52.016025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-03054a12-de04-4fad-a9c5-d4c80fb6ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:52.030800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1230/2461] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:52.034243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494fb7f-e66b-41d5-a533-830cf95f38ac None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:52.049362 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494fb7f-e66b-41d5-a533-830cf95f38ac None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:52.071925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465e33a-a534-438e-b32c-23e011861207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:52.072646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465e33a-a534-438e-b32c-23e011861207 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:52.072942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465e33a-a534-438e-b32c-23e011861207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:52.073226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465e33a-a534-438e-b32c-23e011861207 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:52.077409 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465e33a-a534-438e-b32c-23e011861207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:01:52.077853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465e33a-a534-438e-b32c-23e011861207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:52.085608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465e33a-a534-438e-b32c-23e011861207 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:52.118657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1232/2462] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:01:52.123204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054a12-de04-4fad-a9c5-d4c80fb6ef43 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:52.134731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03054a12-de04-4fad-a9c5-d4c80fb6ef43 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:52.141487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9f40e-c41a-42d3-a82b-273c1c880992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:52.143638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9f40e-c41a-42d3-a82b-273c1c880992 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:52.143842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9f40e-c41a-42d3-a82b-273c1c880992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:52.144134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9f40e-c41a-42d3-a82b-273c1c880992 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:52.145446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9f40e-c41a-42d3-a82b-273c1c880992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:52.149540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9f40e-c41a-42d3-a82b-273c1c880992 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:52.192388 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1231/2463] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:01:52 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:01:52.193536 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465e33a-a534-438e-b32c-23e011861207 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:52.209545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465e33a-a534-438e-b32c-23e011861207 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:52.377385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79cca4-6448-4b3d-b55a-e4b289d364a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:52.378630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79cca4-6448-4b3d-b55a-e4b289d364a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:52.380602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79cca4-6448-4b3d-b55a-e4b289d364a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:52.381169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79cca4-6448-4b3d-b55a-e4b289d364a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:52.382544 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79cca4-6448-4b3d-b55a-e4b289d364a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:52.387083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79cca4-6448-4b3d-b55a-e4b289d364a8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:52.436551 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1233/2464] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:01:52 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:01:52.443066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9f40e-c41a-42d3-a82b-273c1c880992 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:52.513275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9f40e-c41a-42d3-a82b-273c1c880992 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:52.540861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084e583-c98c-4650-be94-a08e294008f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:52.544168 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084e583-c98c-4650-be94-a08e294008f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:52.545458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084e583-c98c-4650-be94-a08e294008f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:52.546028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084e583-c98c-4650-be94-a08e294008f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:52.548726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084e583-c98c-4650-be94-a08e294008f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:52.556224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084e583-c98c-4650-be94-a08e294008f8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:52.598998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79cca4-6448-4b3d-b55a-e4b289d364a8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:52.602284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1232/2465] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:01:52.612160 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:52.624522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79cca4-6448-4b3d-b55a-e4b289d364a8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:52.636095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e045cf-9739-4a8a-854e-0f3bc4f10e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:52.637368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e045cf-9739-4a8a-854e-0f3bc4f10e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:52.637953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e045cf-9739-4a8a-854e-0f3bc4f10e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:52.638465 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e045cf-9739-4a8a-854e-0f3bc4f10e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:52.644816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e045cf-9739-4a8a-854e-0f3bc4f10e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:52.663121 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e045cf-9739-4a8a-854e-0f3bc4f10e19 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:52.692010 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1234/2466] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:01:52.699350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084e583-c98c-4650-be94-a08e294008f8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:52.758624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084e583-c98c-4650-be94-a08e294008f8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:52.781612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafdbcb-52ad-4724-9580-afaf53b00f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:52.786366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafdbcb-52ad-4724-9580-afaf53b00f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:52.786366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafdbcb-52ad-4724-9580-afaf53b00f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:52.786846 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafdbcb-52ad-4724-9580-afaf53b00f5e admin admin] PATH_INFO: `/v3/projects/af058b38bbb94aaaabe5128a341367bc/users/f36474be754d4c959979eb0bd1fd6c29/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:52.836338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafdbcb-52ad-4724-9580-afaf53b00f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af058b38bbb94aaaabe5128a341367bc, user_id=f36474be754d4c959979eb0bd1fd6c29, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:52.844712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafdbcb-52ad-4724-9580-afaf53b00f5e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:52.899235 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1233/2467] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:01:52 2022] PUT /identity/v3/projects/af058b38bbb94aaaabe5128a341367bc/users/f36474be754d4c959979eb0bd1fd6c29/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:01:52.904041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f8962-aa9e-4d8c-b284-41c9f46faca7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:52.904852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f8962-aa9e-4d8c-b284-41c9f46faca7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:52.905270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f8962-aa9e-4d8c-b284-41c9f46faca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:52.997296 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a39f8962-aa9e-4d8c-b284-41c9f46faca7 None None] MFA Rules not processed for user `f36474be754d4c959979eb0bd1fd6c29`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:53.000597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a39f8962-aa9e-4d8c-b284-41c9f46faca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:53.230240 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1235/2468] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:53.255024 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafdbcb-52ad-4724-9580-afaf53b00f5e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:53.257905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0bafdbcb-52ad-4724-9580-afaf53b00f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:53.351797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:01:53.528385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafdbcb-52ad-4724-9580-afaf53b00f5e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:53.545604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc6e4f-83ac-4ed2-ac20-b23374108c5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:53.546780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6e4f-83ac-4ed2-ac20-b23374108c5f service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:53.554419 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6e4f-83ac-4ed2-ac20-b23374108c5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:53.567049 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6e4f-83ac-4ed2-ac20-b23374108c5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:53.610116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc6e4f-83ac-4ed2-ac20-b23374108c5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:53.619083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc6e4f-83ac-4ed2-ac20-b23374108c5f service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:53.664079 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1234/2469] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:54.166491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e550ab-2dfc-4fd1-b7f7-b9c8164e5eef None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:54.166491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e550ab-2dfc-4fd1-b7f7-b9c8164e5eef None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:54.166491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e550ab-2dfc-4fd1-b7f7-b9c8164e5eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:54.256531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-95e550ab-2dfc-4fd1-b7f7-b9c8164e5eef None None] MFA Rules not processed for user `e3075db9329140b0a2c6b0c8b5657613`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:54.273440 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-95e550ab-2dfc-4fd1-b7f7-b9c8164e5eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:54.461637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1236/2470] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:01:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:01:54.554452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc6e4f-83ac-4ed2-ac20-b23374108c5f service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:54.556817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f7dc6e4f-83ac-4ed2-ac20-b23374108c5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:54.770746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc6e4f-83ac-4ed2-ac20-b23374108c5f service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:54.787483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91596f38-98ea-4445-a5d3-155da7c6e697 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61565364dbac41cfac76195c0be88771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:54.788547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596f38-98ea-4445-a5d3-155da7c6e697 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:54.789037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596f38-98ea-4445-a5d3-155da7c6e697 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:54.789519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596f38-98ea-4445-a5d3-155da7c6e697 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:54.802198 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91596f38-98ea-4445-a5d3-155da7c6e697 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:55.016493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91596f38-98ea-4445-a5d3-155da7c6e697 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:55.018251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91596f38-98ea-4445-a5d3-155da7c6e697 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:55.051411 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1235/2471] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:01:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:01:55.506900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda2df6-bb94-42ca-9b19-08f8423f6e53 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:55.507790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda2df6-bb94-42ca-9b19-08f8423f6e53 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:55.508313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda2df6-bb94-42ca-9b19-08f8423f6e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:55.585129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6eda2df6-bb94-42ca-9b19-08f8423f6e53 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:01:55.587305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6eda2df6-bb94-42ca-9b19-08f8423f6e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:55.745902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1237/2472] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 16:01:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:01:55.767398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91596f38-98ea-4445-a5d3-155da7c6e697 service glance] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:01:55.785674 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91596f38-98ea-4445-a5d3-155da7c6e697 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:01:56.064326 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91596f38-98ea-4445-a5d3-155da7c6e697 service glance] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:01:56.081492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6399e9-aa59-4a95-9574-c967999fe511 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:01:56.088322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6399e9-aa59-4a95-9574-c967999fe511 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:01:56.089513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6399e9-aa59-4a95-9574-c967999fe511 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:01:56.092203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6399e9-aa59-4a95-9574-c967999fe511 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:01:56.150517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6399e9-aa59-4a95-9574-c967999fe511 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:01:56.164565 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6399e9-aa59-4a95-9574-c967999fe511 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:01:56.205711 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1236/2473] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:01:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:02:05.459395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda2df6-bb94-42ca-9b19-08f8423f6e53 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:05.462073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6eda2df6-bb94-42ca-9b19-08f8423f6e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:05.499205 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:05.721754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda2df6-bb94-42ca-9b19-08f8423f6e53 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:05.757164 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:05.759136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:05.760349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:05.760464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] PATH_INFO: `/v3/users/cd650abafe754be1bdee17091b8b262c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:05.764107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd650abafe754be1bdee17091b8b262c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:05.768085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:05.977540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd650abafe754be1bdee17091b8b262c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:06.022919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd650abafe754be1bdee17091b8b262c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:06.026366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd650abafe754be1bdee17091b8b262c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:06.043886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd650abafe754be1bdee17091b8b262c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:06.045100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd650abafe754be1bdee17091b8b262c'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:06.078164 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1238/2474] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:02:05 2022] DELETE /identity/v3/users/cd650abafe754be1bdee17091b8b262c => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:02:06.083605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09f280-7bb7-419d-9598-4c00b2c9f28d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:06.084217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09f280-7bb7-419d-9598-4c00b2c9f28d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:06.084217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09f280-7bb7-419d-9598-4c00b2c9f28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:06.098196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:06.126545 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2f09f280-7bb7-419d-9598-4c00b2c9f28d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:06.131653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2f09f280-7bb7-419d-9598-4c00b2c9f28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:06.266992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1237/2475] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:06.294939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:06.297399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:06.481373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88893b8e-c188-4329-9e28-0ff240681f84 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:06.489307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ec05b-4732-4f4f-83f4-971b1cc5a827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:06.490467 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ec05b-4732-4f4f-83f4-971b1cc5a827 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:06.490939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ec05b-4732-4f4f-83f4-971b1cc5a827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:06.491474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ec05b-4732-4f4f-83f4-971b1cc5a827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:06.515330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ec05b-4732-4f4f-83f4-971b1cc5a827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:06.518552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ec05b-4732-4f4f-83f4-971b1cc5a827 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:06.545310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1239/2476] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:02:07.625310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09f280-7bb7-419d-9598-4c00b2c9f28d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:07.627469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2f09f280-7bb7-419d-9598-4c00b2c9f28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:07.652526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09f280-7bb7-419d-9598-4c00b2c9f28d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:07.667262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:07.670259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:07.670633 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:07.671123 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] PATH_INFO: `/v3/projects/b651985906b84f249646979a28c757a2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:07.673977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b651985906b84f249646979a28c757a2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:07.677753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:07.881970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b651985906b84f249646979a28c757a2', 'request_id': 'req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:07.895599 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b651985906b84f249646979a28c757a2', 'request_id': 'req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:07.928005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b651985906b84f249646979a28c757a2', 'request_id': 'req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:07.988340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] The token cache is being invalidate because project b651985906b84f249646979a28c757a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:02:07.989022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:07.992145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:07.997469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1238/2477] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:02:07 2022] DELETE /identity/v3/projects/b651985906b84f249646979a28c757a2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:02:09.983905 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c182b-5360-4a64-81a4-4ce8fb42bc67 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:09.984606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c182b-5360-4a64-81a4-4ce8fb42bc67 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:09.984751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c182b-5360-4a64-81a4-4ce8fb42bc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:10.014901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-b93c182b-5360-4a64-81a4-4ce8fb42bc67 None None] MFA Rules not processed for user `74f447686a3a41ef8300b20c04c9776a`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:10.018140 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b93c182b-5360-4a64-81a4-4ce8fb42bc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:10.095421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:10.223202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1240/2478] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:10.230977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:10.234387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:10.556370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc4f2a-cbdc-4b0c-918a-caa07fd2014a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:10.576171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:10.578357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:10.582575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:10.583609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] PATH_INFO: `/v3/users/f36474be754d4c959979eb0bd1fd6c29` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:10.590659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f36474be754d4c959979eb0bd1fd6c29)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:10.603011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:10.668810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:10.723661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f36474be754d4c959979eb0bd1fd6c29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:10.757581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f36474be754d4c959979eb0bd1fd6c29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:10.779232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f36474be754d4c959979eb0bd1fd6c29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:10.779232 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f36474be754d4c959979eb0bd1fd6c29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:10.785831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f36474be754d4c959979eb0bd1fd6c29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:10.815336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1239/2479] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:02:10 2022] DELETE /identity/v3/users/f36474be754d4c959979eb0bd1fd6c29 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:02:10.819716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ea755-fe99-4ebb-aec5-ea0591d62372 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:10.820225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ea755-fe99-4ebb-aec5-ea0591d62372 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:10.820765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ea755-fe99-4ebb-aec5-ea0591d62372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:10.888485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-756ea755-fe99-4ebb-aec5-ea0591d62372 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:10.892941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-756ea755-fe99-4ebb-aec5-ea0591d62372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:11.135238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1241/2480] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:11.180320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:11.184575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:11.355210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff40b5a-ee59-4fca-ba4c-282774ae5524 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:11.363911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dcb8f-d557-451c-b17a-f412170ce641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:11.364743 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dcb8f-d557-451c-b17a-f412170ce641 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:11.365037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dcb8f-d557-451c-b17a-f412170ce641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:11.365315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dcb8f-d557-451c-b17a-f412170ce641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:11.387631 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dcb8f-d557-451c-b17a-f412170ce641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:11.391262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dcb8f-d557-451c-b17a-f412170ce641 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:11.413307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1240/2481] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:02:12.593166 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ea755-fe99-4ebb-aec5-ea0591d62372 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:12.594773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-756ea755-fe99-4ebb-aec5-ea0591d62372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:12.611075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ea755-fe99-4ebb-aec5-ea0591d62372 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:12.621918 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:12.622926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:12.623351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:12.623706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] PATH_INFO: `/v3/projects/af058b38bbb94aaaabe5128a341367bc` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:12.625942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af058b38bbb94aaaabe5128a341367bc)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:12.630713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:12.776891 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af058b38bbb94aaaabe5128a341367bc', 'request_id': 'req-beb07b63-980c-4de5-ba4e-310e4c877542'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:12.794555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af058b38bbb94aaaabe5128a341367bc', 'request_id': 'req-beb07b63-980c-4de5-ba4e-310e4c877542'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:12.809254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af058b38bbb94aaaabe5128a341367bc', 'request_id': 'req-beb07b63-980c-4de5-ba4e-310e4c877542'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:12.838870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] The token cache is being invalidate because project af058b38bbb94aaaabe5128a341367bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:02:12.839220 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:12.843409 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beb07b63-980c-4de5-ba4e-310e4c877542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:12.845667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1242/2482] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:02:12 2022] DELETE /identity/v3/projects/af058b38bbb94aaaabe5128a341367bc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:02:12.854116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026eabe-fa73-4d7d-8a90-7ca1c717a78f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:12.857045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026eabe-fa73-4d7d-8a90-7ca1c717a78f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:12.857911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026eabe-fa73-4d7d-8a90-7ca1c717a78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:12.937689 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2026eabe-fa73-4d7d-8a90-7ca1c717a78f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:12.964412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2026eabe-fa73-4d7d-8a90-7ca1c717a78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:13.098634 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1241/2483] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:13.107874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b6762-0187-417b-b3b5-b6fd901bd338 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:13.108244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b6762-0187-417b-b3b5-b6fd901bd338 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:13.108458 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b6762-0187-417b-b3b5-b6fd901bd338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:13.134900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-da2b6762-0187-417b-b3b5-b6fd901bd338 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:13.136812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-da2b6762-0187-417b-b3b5-b6fd901bd338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:13.166766 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1243/2484] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:13.167638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026eabe-fa73-4d7d-8a90-7ca1c717a78f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:13.171868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026eabe-fa73-4d7d-8a90-7ca1c717a78f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:13.192528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f0ce-da32-4b3f-a23e-89d64ca46bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:13.193500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f0ce-da32-4b3f-a23e-89d64ca46bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:13.194324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f0ce-da32-4b3f-a23e-89d64ca46bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:13.194781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f0ce-da32-4b3f-a23e-89d64ca46bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:13.195982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f0ce-da32-4b3f-a23e-89d64ca46bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:02:13.196468 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f0ce-da32-4b3f-a23e-89d64ca46bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:13.198711 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f0ce-da32-4b3f-a23e-89d64ca46bd9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:13.225806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1242/2485] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:02:13.231338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b6762-0187-417b-b3b5-b6fd901bd338 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:13.249339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b6762-0187-417b-b3b5-b6fd901bd338 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:13.261013 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce27e9-76ea-40fc-b82c-32ee0c2f3d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:13.262177 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce27e9-76ea-40fc-b82c-32ee0c2f3d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:13.262698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce27e9-76ea-40fc-b82c-32ee0c2f3d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:13.263238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce27e9-76ea-40fc-b82c-32ee0c2f3d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:13.264529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce27e9-76ea-40fc-b82c-32ee0c2f3d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:13.269675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce27e9-76ea-40fc-b82c-32ee0c2f3d77 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:13.320328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1244/2486] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:02:13 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:02:13.321953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f0ce-da32-4b3f-a23e-89d64ca46bd9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:13.335647 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f0ce-da32-4b3f-a23e-89d64ca46bd9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:13.388568 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:13.439842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405a98-04df-4691-9e96-7d760e63cd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:13.440668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405a98-04df-4691-9e96-7d760e63cd8e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:13.441056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405a98-04df-4691-9e96-7d760e63cd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:13.441375 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405a98-04df-4691-9e96-7d760e63cd8e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:13.442084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21405a98-04df-4691-9e96-7d760e63cd8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:13.444437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21405a98-04df-4691-9e96-7d760e63cd8e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:13.488280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1243/2487] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:02:13 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:02:13.490130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce27e9-76ea-40fc-b82c-32ee0c2f3d77 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:13.501770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce27e9-76ea-40fc-b82c-32ee0c2f3d77 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:13.507496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f6a7-6259-411c-8610-794abc818fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:13.508374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f6a7-6259-411c-8610-794abc818fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:13.508768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f6a7-6259-411c-8610-794abc818fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:13.509172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f6a7-6259-411c-8610-794abc818fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:13.510152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9f6a7-6259-411c-8610-794abc818fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:13.511994 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9f6a7-6259-411c-8610-794abc818fe4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:13.529817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1245/2488] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:02:13.536462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405a98-04df-4691-9e96-7d760e63cd8e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:13.555863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405a98-04df-4691-9e96-7d760e63cd8e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:13.562915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89e6f6-e57f-406e-9861-405f4dbc8222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:13.563852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e6f6-e57f-406e-9861-405f4dbc8222 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:13.564256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e6f6-e57f-406e-9861-405f4dbc8222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:13.564639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e6f6-e57f-406e-9861-405f4dbc8222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:13.566045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89e6f6-e57f-406e-9861-405f4dbc8222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:13.568467 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89e6f6-e57f-406e-9861-405f4dbc8222 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:13.585525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1244/2489] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:02:13.590225 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f6a7-6259-411c-8610-794abc818fe4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:13.602374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f6a7-6259-411c-8610-794abc818fe4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:13.610112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246eb7-d7f2-4013-b548-0e3104b3487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:13.611636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246eb7-d7f2-4013-b548-0e3104b3487c admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:13.612095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246eb7-d7f2-4013-b548-0e3104b3487c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:13.612546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246eb7-d7f2-4013-b548-0e3104b3487c admin admin] PATH_INFO: `/v3/projects/fa8c2abc8bd8429cb6b41cdd0688e13f/users/5cd284ab031f46dbaa17043f7ea83dc9/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:13.634249 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc246eb7-d7f2-4013-b548-0e3104b3487c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8c2abc8bd8429cb6b41cdd0688e13f, user_id=5cd284ab031f46dbaa17043f7ea83dc9, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:13.637283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc246eb7-d7f2-4013-b548-0e3104b3487c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:13.651278 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:13.658145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1246/2490] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:02:13 2022] PUT /identity/v3/projects/fa8c2abc8bd8429cb6b41cdd0688e13f/users/5cd284ab031f46dbaa17043f7ea83dc9/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:02:13.674586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35675-e3f7-4223-97c8-ba123c35ed2e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:13.674586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35675-e3f7-4223-97c8-ba123c35ed2e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:13.674586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35675-e3f7-4223-97c8-ba123c35ed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:13.719877 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-abc35675-e3f7-4223-97c8-ba123c35ed2e None None] MFA Rules not processed for user `5cd284ab031f46dbaa17043f7ea83dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:13.723632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-abc35675-e3f7-4223-97c8-ba123c35ed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:13.846050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1245/2491] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:02:13.855512 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246eb7-d7f2-4013-b548-0e3104b3487c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:13.858842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fc246eb7-d7f2-4013-b548-0e3104b3487c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:14.009136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246eb7-d7f2-4013-b548-0e3104b3487c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:14.013353 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b656fe-3a4e-4d88-8f37-37f3c4dadac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:14.014051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b656fe-3a4e-4d88-8f37-37f3c4dadac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:14.014341 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b656fe-3a4e-4d88-8f37-37f3c4dadac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:14.014631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b656fe-3a4e-4d88-8f37-37f3c4dadac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:14.027213 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b656fe-3a4e-4d88-8f37-37f3c4dadac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:14.031015 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b656fe-3a4e-4d88-8f37-37f3c4dadac3 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:14.045665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1247/2492] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:02:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:02:14.882450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35675-e3f7-4223-97c8-ba123c35ed2e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:14.884817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-abc35675-e3f7-4223-97c8-ba123c35ed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:15.081417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35675-e3f7-4223-97c8-ba123c35ed2e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:15.094986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bf540-2924-410f-a204-e5f31bdd5b90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:15.096104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bf540-2924-410f-a204-e5f31bdd5b90 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:15.096613 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bf540-2924-410f-a204-e5f31bdd5b90 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:15.097759 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bf540-2924-410f-a204-e5f31bdd5b90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:15.101614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1c3bf540-2924-410f-a204-e5f31bdd5b90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:15.124147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bf540-2924-410f-a204-e5f31bdd5b90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:15.126076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bf540-2924-410f-a204-e5f31bdd5b90 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:15.144140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1246/2493] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:02:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:02:16.792813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a1a1a-7371-44bb-81a5-9d52b379d18d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:16.793623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a1a1a-7371-44bb-81a5-9d52b379d18d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:16.793623 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a1a1a-7371-44bb-81a5-9d52b379d18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:16.830212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-774a1a1a-7371-44bb-81a5-9d52b379d18d None None] MFA Rules not processed for user `3c3dba1352544598a85b900195b64300`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:16.833973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-774a1a1a-7371-44bb-81a5-9d52b379d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:16.996036 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1248/2494] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:18.196571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bf540-2924-410f-a204-e5f31bdd5b90 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:18.245338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:18.380925 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bf540-2924-410f-a204-e5f31bdd5b90 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:18.387553 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:18.388607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:18.389003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:18.389420 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] PATH_INFO: `/v3/users/5cd284ab031f46dbaa17043f7ea83dc9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:18.390807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd284ab031f46dbaa17043f7ea83dc9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:18.393544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:18.475352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd284ab031f46dbaa17043f7ea83dc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:18.505685 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd284ab031f46dbaa17043f7ea83dc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:18.518027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd284ab031f46dbaa17043f7ea83dc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:18.520694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd284ab031f46dbaa17043f7ea83dc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:18.539917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd284ab031f46dbaa17043f7ea83dc9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:18.558188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1247/2495] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:02:18 2022] DELETE /identity/v3/users/5cd284ab031f46dbaa17043f7ea83dc9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:02:18.564109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e8b0a-606f-484c-bb9d-8e46ef47f7d9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:18.564109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e8b0a-606f-484c-bb9d-8e46ef47f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:18.564845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e8b0a-606f-484c-bb9d-8e46ef47f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:18.605549 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-989e8b0a-606f-484c-bb9d-8e46ef47f7d9 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:18.608054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-989e8b0a-606f-484c-bb9d-8e46ef47f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:18.812338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1249/2496] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:18.842237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:18.845802 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:18.993004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73eb37-e1ca-4bcf-9c4a-1cd39608edd8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:18.999929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c014e9-9b8c-4548-85f8-6961566e935d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:19.001376 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c014e9-9b8c-4548-85f8-6961566e935d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:19.002101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c014e9-9b8c-4548-85f8-6961566e935d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:19.003253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c014e9-9b8c-4548-85f8-6961566e935d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:19.024508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c014e9-9b8c-4548-85f8-6961566e935d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:19.026948 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c014e9-9b8c-4548-85f8-6961566e935d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:19.043704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1248/2497] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:02:19.674224 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e8b0a-606f-484c-bb9d-8e46ef47f7d9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:19.677184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-989e8b0a-606f-484c-bb9d-8e46ef47f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:19.744690 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e8b0a-606f-484c-bb9d-8e46ef47f7d9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:19.758090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:19.759488 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:19.760050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:19.760942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] PATH_INFO: `/v3/projects/fa8c2abc8bd8429cb6b41cdd0688e13f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:19.765726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8c2abc8bd8429cb6b41cdd0688e13f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:19.771294 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:19.859468 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:19.866502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8c2abc8bd8429cb6b41cdd0688e13f', 'request_id': 'req-7664ef2d-d34a-49f3-8395-184af1d61708'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:19.878099 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8c2abc8bd8429cb6b41cdd0688e13f', 'request_id': 'req-7664ef2d-d34a-49f3-8395-184af1d61708'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:19.888731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8c2abc8bd8429cb6b41cdd0688e13f', 'request_id': 'req-7664ef2d-d34a-49f3-8395-184af1d61708'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:19.904325 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] The token cache is being invalidate because project fa8c2abc8bd8429cb6b41cdd0688e13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:02:19.904892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:19.905688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7664ef2d-d34a-49f3-8395-184af1d61708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:19.907466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1250/2498] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:02:19 2022] DELETE /identity/v3/projects/fa8c2abc8bd8429cb6b41cdd0688e13f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:02:19.914910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4b372-c588-452a-8791-d07ba53c064a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:19.915798 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4b372-c588-452a-8791-d07ba53c064a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:19.916428 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4b372-c588-452a-8791-d07ba53c064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:19.949253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d8c4b372-c588-452a-8791-d07ba53c064a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:19.951144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d8c4b372-c588-452a-8791-d07ba53c064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:19.997320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:20.058550 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1249/2499] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:20.060758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8651b-fa5b-4454-b886-d56cc818b13c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:20.061490 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8651b-fa5b-4454-b886-d56cc818b13c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:20.062052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8651b-fa5b-4454-b886-d56cc818b13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:20.091065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-07b8651b-fa5b-4454-b886-d56cc818b13c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:20.092372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-07b8651b-fa5b-4454-b886-d56cc818b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:20.103292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1251/2500] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:20.108973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4b372-c588-452a-8791-d07ba53c064a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:20.122327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4b372-c588-452a-8791-d07ba53c064a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:20.128708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7f6e7-6409-4d62-8ffe-7992068456cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:20.129602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7f6e7-6409-4d62-8ffe-7992068456cf admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:20.129957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7f6e7-6409-4d62-8ffe-7992068456cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:20.130304 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7f6e7-6409-4d62-8ffe-7992068456cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:20.131189 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7f6e7-6409-4d62-8ffe-7992068456cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:02:20.131581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7f6e7-6409-4d62-8ffe-7992068456cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:20.133409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7f6e7-6409-4d62-8ffe-7992068456cf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:20.151675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1250/2501] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:02:20.156739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8651b-fa5b-4454-b886-d56cc818b13c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:20.169695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8651b-fa5b-4454-b886-d56cc818b13c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:20.176596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dbca8-2398-48e4-b8d5-0cc085376441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:20.177292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dbca8-2398-48e4-b8d5-0cc085376441 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:20.177584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dbca8-2398-48e4-b8d5-0cc085376441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:20.177871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dbca8-2398-48e4-b8d5-0cc085376441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:20.178592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dbca8-2398-48e4-b8d5-0cc085376441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:20.180663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dbca8-2398-48e4-b8d5-0cc085376441 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:20.224369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1252/2502] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:02:20 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:02:20.228817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7f6e7-6409-4d62-8ffe-7992068456cf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:20.242648 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7f6e7-6409-4d62-8ffe-7992068456cf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:20.375698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4142b0-660d-42d2-8406-86a6d49fa67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:20.377044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4142b0-660d-42d2-8406-86a6d49fa67d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:20.379314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4142b0-660d-42d2-8406-86a6d49fa67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:20.379314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4142b0-660d-42d2-8406-86a6d49fa67d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:20.380229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4142b0-660d-42d2-8406-86a6d49fa67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:20.384265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4142b0-660d-42d2-8406-86a6d49fa67d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:20.416709 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1251/2503] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:02:20 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:02:20.421025 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dbca8-2398-48e4-b8d5-0cc085376441 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:20.435376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dbca8-2398-48e4-b8d5-0cc085376441 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:20.444598 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a96a4-60cb-48b5-8e02-bb618a8753a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:20.446144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a96a4-60cb-48b5-8e02-bb618a8753a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:20.446850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a96a4-60cb-48b5-8e02-bb618a8753a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:20.447520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a96a4-60cb-48b5-8e02-bb618a8753a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:20.461759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a96a4-60cb-48b5-8e02-bb618a8753a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:20.482133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a96a4-60cb-48b5-8e02-bb618a8753a7 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:20.523257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4142b0-660d-42d2-8406-86a6d49fa67d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:20.532688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1253/2504] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:02:20.562011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4142b0-660d-42d2-8406-86a6d49fa67d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:20.575702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94bd21-7a38-429c-8427-47179e122993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:20.576767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94bd21-7a38-429c-8427-47179e122993 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:20.577279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94bd21-7a38-429c-8427-47179e122993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:20.578654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94bd21-7a38-429c-8427-47179e122993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:20.579112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94bd21-7a38-429c-8427-47179e122993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:20.583878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94bd21-7a38-429c-8427-47179e122993 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:20.605620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1252/2505] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:02:20.611856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a96a4-60cb-48b5-8e02-bb618a8753a7 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:20.640450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a96a4-60cb-48b5-8e02-bb618a8753a7 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:20.651913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517fdc-b5fb-4a75-8c19-4ea8940fc23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:20.654189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517fdc-b5fb-4a75-8c19-4ea8940fc23b admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:20.656604 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517fdc-b5fb-4a75-8c19-4ea8940fc23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:20.657189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517fdc-b5fb-4a75-8c19-4ea8940fc23b admin admin] PATH_INFO: `/v3/projects/cb6bda7a345c4ea2831098452bbedd5c/users/ba3ffb852d0e416794b6a04950297b7a/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:20.700282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d517fdc-b5fb-4a75-8c19-4ea8940fc23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6bda7a345c4ea2831098452bbedd5c, user_id=ba3ffb852d0e416794b6a04950297b7a, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:20.707467 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d517fdc-b5fb-4a75-8c19-4ea8940fc23b admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:20.736645 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1254/2506] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:02:20 2022] PUT /identity/v3/projects/cb6bda7a345c4ea2831098452bbedd5c/users/ba3ffb852d0e416794b6a04950297b7a/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:02:20.758408 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0533d-9194-4c2d-a606-37c965736ad3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:20.759059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0533d-9194-4c2d-a606-37c965736ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:20.759573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0533d-9194-4c2d-a606-37c965736ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:20.838281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-16a0533d-9194-4c2d-a606-37c965736ad3 None None] MFA Rules not processed for user `ba3ffb852d0e416794b6a04950297b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:20.841841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-16a0533d-9194-4c2d-a606-37c965736ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:21.093687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1253/2507] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:02:21.165344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517fdc-b5fb-4a75-8c19-4ea8940fc23b admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:21.169058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1d517fdc-b5fb-4a75-8c19-4ea8940fc23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:21.323081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517fdc-b5fb-4a75-8c19-4ea8940fc23b admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:21.335630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e847829-7762-436a-947b-1a1cb50e452d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:21.336492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e847829-7762-436a-947b-1a1cb50e452d service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:21.336792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e847829-7762-436a-947b-1a1cb50e452d service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:21.337130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e847829-7762-436a-947b-1a1cb50e452d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:21.349085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868c92-bf9f-4a45-a886-d0a93897a628 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:21.349605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868c92-bf9f-4a45-a886-d0a93897a628 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:21.350078 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868c92-bf9f-4a45-a886-d0a93897a628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:21.369004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e847829-7762-436a-947b-1a1cb50e452d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:21.374986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e847829-7762-436a-947b-1a1cb50e452d service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:21.405327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-da868c92-bf9f-4a45-a886-d0a93897a628 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:21.407522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da868c92-bf9f-4a45-a886-d0a93897a628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:21.421858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1255/2508] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:02:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:02:21.525155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:21.654558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1254/2509] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 16:02:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:02:21.665311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e847829-7762-436a-947b-1a1cb50e452d service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:21.667271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5e847829-7762-436a-947b-1a1cb50e452d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:21.844978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e847829-7762-436a-947b-1a1cb50e452d service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:21.868806 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63291cf7-4b0a-4cd0-a2c2-58f2ddef6c53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:21.871998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63291cf7-4b0a-4cd0-a2c2-58f2ddef6c53 service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:21.876144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63291cf7-4b0a-4cd0-a2c2-58f2ddef6c53 service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:21.877337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63291cf7-4b0a-4cd0-a2c2-58f2ddef6c53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:21.941612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63291cf7-4b0a-4cd0-a2c2-58f2ddef6c53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:21.954525 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63291cf7-4b0a-4cd0-a2c2-58f2ddef6c53 service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:21.990311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:22.021466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1256/2510] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:02:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:02:31.625246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=11 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:33.616309 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868c92-bf9f-4a45-a886-d0a93897a628 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:33.749803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868c92-bf9f-4a45-a886-d0a93897a628 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:33.765930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:33.767794 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:33.768360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:33.768874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] PATH_INFO: `/v3/users/ba3ffb852d0e416794b6a04950297b7a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:33.771236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3ffb852d0e416794b6a04950297b7a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:33.774944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:33.881728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3ffb852d0e416794b6a04950297b7a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:33.913469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3ffb852d0e416794b6a04950297b7a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:33.931763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3ffb852d0e416794b6a04950297b7a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:33.933208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3ffb852d0e416794b6a04950297b7a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:33.955091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3ffb852d0e416794b6a04950297b7a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:33.976666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1255/2511] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:02:33 2022] DELETE /identity/v3/users/ba3ffb852d0e416794b6a04950297b7a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:02:33.985954 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62977fcb-4b50-4743-9dd4-8fad8499bc8c None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:33.987629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62977fcb-4b50-4743-9dd4-8fad8499bc8c None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:33.987629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62977fcb-4b50-4743-9dd4-8fad8499bc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:34.024049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-62977fcb-4b50-4743-9dd4-8fad8499bc8c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:34.025864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-62977fcb-4b50-4743-9dd4-8fad8499bc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:34.167672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1257/2512] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:34.183933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:34.187516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:34.344342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579f772-1547-4d58-aca2-c8a1cf95dbc0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:34.351788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61685de3-a7c6-4208-b253-030c29af9ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:34.352989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61685de3-a7c6-4208-b253-030c29af9ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:34.353721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61685de3-a7c6-4208-b253-030c29af9ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:34.354277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61685de3-a7c6-4208-b253-030c29af9ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:34.369215 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61685de3-a7c6-4208-b253-030c29af9ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:34.370871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61685de3-a7c6-4208-b253-030c29af9ad9 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:34.386804 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1256/2513] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:02:34.764303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62977fcb-4b50-4743-9dd4-8fad8499bc8c None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:34.767273 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-62977fcb-4b50-4743-9dd4-8fad8499bc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:34.803487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62977fcb-4b50-4743-9dd4-8fad8499bc8c None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:34.813117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:34.815414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:34.815898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:34.816386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] PATH_INFO: `/v3/projects/cb6bda7a345c4ea2831098452bbedd5c` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:34.818801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6bda7a345c4ea2831098452bbedd5c)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:34.825746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:34.968005 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6bda7a345c4ea2831098452bbedd5c', 'request_id': 'req-beaaecae-7064-4982-bc23-23986ce1cdef'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:34.993502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6bda7a345c4ea2831098452bbedd5c', 'request_id': 'req-beaaecae-7064-4982-bc23-23986ce1cdef'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:35.007341 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6bda7a345c4ea2831098452bbedd5c', 'request_id': 'req-beaaecae-7064-4982-bc23-23986ce1cdef'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:35.022031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] The token cache is being invalidate because project cb6bda7a345c4ea2831098452bbedd5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:02:35.022341 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:35.023040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:02:35.024991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1258/2514] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:02:34 2022] DELETE /identity/v3/projects/cb6bda7a345c4ea2831098452bbedd5c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:02:37.320714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f320d-62d2-4f87-bd1b-5af4120d06c7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:37.321157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f320d-62d2-4f87-bd1b-5af4120d06c7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:37.321507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f320d-62d2-4f87-bd1b-5af4120d06c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:37.385263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-331f320d-62d2-4f87-bd1b-5af4120d06c7 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:37.387369 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-331f320d-62d2-4f87-bd1b-5af4120d06c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:37.436146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:37.534307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1257/2515] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 16:02:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:37.556309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:37.559529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:37.725367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaecae-7064-4982-bc23-23986ce1cdef admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:37.748304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970373b-0324-498a-ba8c-6cb6fe65c198 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:37.751498 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970373b-0324-498a-ba8c-6cb6fe65c198 service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:37.753771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970373b-0324-498a-ba8c-6cb6fe65c198 service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:37.754382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970373b-0324-498a-ba8c-6cb6fe65c198 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:37.773288 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970373b-0324-498a-ba8c-6cb6fe65c198 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:37.775893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970373b-0324-498a-ba8c-6cb6fe65c198 service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:37.804798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1259/2516] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:02:47.524174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=15 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:47.790001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:02:47.842085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52744a-8f7c-453e-a380-cfbfd86288bb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:47.842700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52744a-8f7c-453e-a380-cfbfd86288bb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:47.843132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52744a-8f7c-453e-a380-cfbfd86288bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:47.866754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7d52744a-8f7c-453e-a380-cfbfd86288bb None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:47.868800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7d52744a-8f7c-453e-a380-cfbfd86288bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:47.953008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1258/2517] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:02:47.993732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970373b-0324-498a-ba8c-6cb6fe65c198 service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:47.996978 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c970373b-0324-498a-ba8c-6cb6fe65c198 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:48.446482 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970373b-0324-498a-ba8c-6cb6fe65c198 service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:48.456630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa244d-435c-40ec-88ef-816fbce48ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:48.457373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa244d-435c-40ec-88ef-816fbce48ecd service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:48.457799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa244d-435c-40ec-88ef-816fbce48ecd service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:48.457983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa244d-435c-40ec-88ef-816fbce48ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:48.477002 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa244d-435c-40ec-88ef-816fbce48ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:48.479431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa244d-435c-40ec-88ef-816fbce48ecd service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:48.500640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1260/2518] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:02:54.449829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f50b-e05d-4e0b-a231-08b29cfa8084 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:54.450771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f50b-e05d-4e0b-a231-08b29cfa8084 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:54.450771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f50b-e05d-4e0b-a231-08b29cfa8084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:54.484258 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fd34f50b-e05d-4e0b-a231-08b29cfa8084 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:02:54.487478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fd34f50b-e05d-4e0b-a231-08b29cfa8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:02:54.504834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1259/2519] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:02:54.554176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa244d-435c-40ec-88ef-816fbce48ecd service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:02:54.592051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa244d-435c-40ec-88ef-816fbce48ecd service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:02:54.607434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af9ff1-ca58-4e48-9f61-8c8e54c5bf06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:02:54.608710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af9ff1-ca58-4e48-9f61-8c8e54c5bf06 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:54.609249 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af9ff1-ca58-4e48-9f61-8c8e54c5bf06 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:54.609765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af9ff1-ca58-4e48-9f61-8c8e54c5bf06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:02:54.632577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af9ff1-ca58-4e48-9f61-8c8e54c5bf06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:02:54.636024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af9ff1-ca58-4e48-9f61-8c8e54c5bf06 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:02:54.659699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1261/2520] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:02:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:02:59.991291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f4f9-2094-4308-9eed-3d8fb05022e7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:02:59.991901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f4f9-2094-4308-9eed-3d8fb05022e7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:02:59.992842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f4f9-2094-4308-9eed-3d8fb05022e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:00.043196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-eb34f4f9-2094-4308-9eed-3d8fb05022e7 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:00.044987 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eb34f4f9-2094-4308-9eed-3d8fb05022e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:00.071120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1260/2521] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:03:00.151796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af9ff1-ca58-4e48-9f61-8c8e54c5bf06 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:00.171587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af9ff1-ca58-4e48-9f61-8c8e54c5bf06 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:00.180962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086d76a-55ab-46f4-ad3a-7b8f7812bd25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:00.181812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086d76a-55ab-46f4-ad3a-7b8f7812bd25 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:00.182399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086d76a-55ab-46f4-ad3a-7b8f7812bd25 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:00.182943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086d76a-55ab-46f4-ad3a-7b8f7812bd25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:00.195747 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086d76a-55ab-46f4-ad3a-7b8f7812bd25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:00.197372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086d76a-55ab-46f4-ad3a-7b8f7812bd25 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:00.211349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1262/2522] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:03:03.199348 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6103ab4-f460-4406-a408-f6b919d8e154 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:03.200309 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6103ab4-f460-4406-a408-f6b919d8e154 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:03.200309 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6103ab4-f460-4406-a408-f6b919d8e154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:03.220202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d6103ab4-f460-4406-a408-f6b919d8e154 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:03.221569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d6103ab4-f460-4406-a408-f6b919d8e154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:03.229728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1261/2523] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jun 21 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:03:03.244673 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086d76a-55ab-46f4-ad3a-7b8f7812bd25 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:03.258022 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086d76a-55ab-46f4-ad3a-7b8f7812bd25 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:03.263618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca105e-4a46-4842-936a-7573fa2df461 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:03.264305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca105e-4a46-4842-936a-7573fa2df461 service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:03.264591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca105e-4a46-4842-936a-7573fa2df461 service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:03.264889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca105e-4a46-4842-936a-7573fa2df461 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:03.276415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca105e-4a46-4842-936a-7573fa2df461 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:03.278234 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca105e-4a46-4842-936a-7573fa2df461 service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:03.289367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1263/2524] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:03:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 16:03:05.443111 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6103ab4-f460-4406-a408-f6b919d8e154 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:05.445210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d6103ab4-f460-4406-a408-f6b919d8e154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:05.465230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6103ab4-f460-4406-a408-f6b919d8e154 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:05.470560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:05.472196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:05.472712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:05.473217 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] PATH_INFO: `/v3/users/e1b76ba52fe447a5bbf620076c9140f1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:05.475537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b76ba52fe447a5bbf620076c9140f1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:05.479413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:05.541400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b76ba52fe447a5bbf620076c9140f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:05.555279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b76ba52fe447a5bbf620076c9140f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:05.564294 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b76ba52fe447a5bbf620076c9140f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:05.564953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b76ba52fe447a5bbf620076c9140f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:05.574008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-db2f504d-490b-4c02-ab7e-3036fba9c955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b76ba52fe447a5bbf620076c9140f1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:05.582396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1262/2525] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:03:05 2022] DELETE /identity/v3/users/e1b76ba52fe447a5bbf620076c9140f1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:03:05.804981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca105e-4a46-4842-936a-7573fa2df461 service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:05.824331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca105e-4a46-4842-936a-7573fa2df461 service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:05.926906 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:05.928492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:05.928939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:05.929425 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] PATH_INFO: `/v3/projects/ac850ac986b648999ee18a4ad79033b4` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:05.932033 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac850ac986b648999ee18a4ad79033b4)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:05.935630 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:05.998461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:06.000535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac850ac986b648999ee18a4ad79033b4', 'request_id': 'req-03934b83-7c57-4284-b56f-3ada104d8f53'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:06.009451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac850ac986b648999ee18a4ad79033b4', 'request_id': 'req-03934b83-7c57-4284-b56f-3ada104d8f53'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:06.018795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac850ac986b648999ee18a4ad79033b4', 'request_id': 'req-03934b83-7c57-4284-b56f-3ada104d8f53'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:06.033580 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] The token cache is being invalidate because project ac850ac986b648999ee18a4ad79033b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:03:06.034012 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:06.034947 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-03934b83-7c57-4284-b56f-3ada104d8f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:06.037374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1264/2526] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:03:05 2022] DELETE /identity/v3/projects/ac850ac986b648999ee18a4ad79033b4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:03:06.045680 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4fcf7-b1eb-4e29-b4c1-403e8581699b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:06.046091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4fcf7-b1eb-4e29-b4c1-403e8581699b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:06.046573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4fcf7-b1eb-4e29-b4c1-403e8581699b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:06.080660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-acb4fcf7-b1eb-4e29-b4c1-403e8581699b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:06.080660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-acb4fcf7-b1eb-4e29-b4c1-403e8581699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:06.164884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:06.182885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1263/2527] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:03:06.192085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a13d-e30e-4715-ad9d-ceac29594e3a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:06.192553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a13d-e30e-4715-ad9d-ceac29594e3a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:06.192948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a13d-e30e-4715-ad9d-ceac29594e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:06.224783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d7b2a13d-e30e-4715-ad9d-ceac29594e3a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:06.227209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d7b2a13d-e30e-4715-ad9d-ceac29594e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:06.242292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1265/2528] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:03:06.246586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4fcf7-b1eb-4e29-b4c1-403e8581699b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:06.261092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4fcf7-b1eb-4e29-b4c1-403e8581699b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:06.270140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29cef5-7feb-49e6-ba7a-2d4886b42282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:06.271397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29cef5-7feb-49e6-ba7a-2d4886b42282 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:06.271908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29cef5-7feb-49e6-ba7a-2d4886b42282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:06.272421 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29cef5-7feb-49e6-ba7a-2d4886b42282 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:06.273860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29cef5-7feb-49e6-ba7a-2d4886b42282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:03:06.274406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29cef5-7feb-49e6-ba7a-2d4886b42282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:06.277034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29cef5-7feb-49e6-ba7a-2d4886b42282 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:06.299612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1264/2529] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:03:06.301237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2a13d-e30e-4715-ad9d-ceac29594e3a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:06.313047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2a13d-e30e-4715-ad9d-ceac29594e3a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:06.320040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfd489-83a9-42c9-ba69-9dfd055d3dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:06.320920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfd489-83a9-42c9-ba69-9dfd055d3dac admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:06.321391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfd489-83a9-42c9-ba69-9dfd055d3dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:06.321770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfd489-83a9-42c9-ba69-9dfd055d3dac admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:06.322614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfd489-83a9-42c9-ba69-9dfd055d3dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:06.325092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfd489-83a9-42c9-ba69-9dfd055d3dac admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:06.361454 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1266/2530] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:03:06 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:03:06.363212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29cef5-7feb-49e6-ba7a-2d4886b42282 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:06.375208 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29cef5-7feb-49e6-ba7a-2d4886b42282 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:06.473969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c5098-2855-4d97-a98f-cdd8b099c68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:06.475059 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5098-2855-4d97-a98f-cdd8b099c68f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:06.475596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5098-2855-4d97-a98f-cdd8b099c68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:06.476049 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5098-2855-4d97-a98f-cdd8b099c68f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:06.476974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c5098-2855-4d97-a98f-cdd8b099c68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:06.479482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c5098-2855-4d97-a98f-cdd8b099c68f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:06.513211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1265/2531] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:03:06 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:03:06.519115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfd489-83a9-42c9-ba69-9dfd055d3dac admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:06.532906 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfd489-83a9-42c9-ba69-9dfd055d3dac admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:06.538754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827305d4-2ad8-4aae-92e1-22a392a56aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:06.539521 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827305d4-2ad8-4aae-92e1-22a392a56aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:06.539818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827305d4-2ad8-4aae-92e1-22a392a56aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:06.540190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827305d4-2ad8-4aae-92e1-22a392a56aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:06.541146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827305d4-2ad8-4aae-92e1-22a392a56aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:06.542870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827305d4-2ad8-4aae-92e1-22a392a56aa5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:06.556171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1267/2532] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:03:06.564630 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c5098-2855-4d97-a98f-cdd8b099c68f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:06.576995 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c5098-2855-4d97-a98f-cdd8b099c68f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:06.582738 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6636-efd7-4cb6-a4b3-b98448d5ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:06.583472 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6636-efd7-4cb6-a4b3-b98448d5ba01 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:06.583849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6636-efd7-4cb6-a4b3-b98448d5ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:06.584141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6636-efd7-4cb6-a4b3-b98448d5ba01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:06.584892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e6636-efd7-4cb6-a4b3-b98448d5ba01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:06.586779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e6636-efd7-4cb6-a4b3-b98448d5ba01 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:06.600142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1266/2533] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:03:06.609120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827305d4-2ad8-4aae-92e1-22a392a56aa5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:06.629697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827305d4-2ad8-4aae-92e1-22a392a56aa5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:06.635679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ccd02-a1ef-446f-b039-45ff4f51c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:06.636609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ccd02-a1ef-446f-b039-45ff4f51c40a admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:06.636913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ccd02-a1ef-446f-b039-45ff4f51c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:06.637378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ccd02-a1ef-446f-b039-45ff4f51c40a admin admin] PATH_INFO: `/v3/projects/1ebfd91a71ec407f821f0fa2a1b75be7/users/4649f48e83644370bcd0a365a468744f/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:06.656393 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ccd02-a1ef-446f-b039-45ff4f51c40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebfd91a71ec407f821f0fa2a1b75be7, user_id=4649f48e83644370bcd0a365a468744f, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:06.660041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ccd02-a1ef-446f-b039-45ff4f51c40a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:06.688144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1268/2534] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:03:06 2022] PUT /identity/v3/projects/1ebfd91a71ec407f821f0fa2a1b75be7/users/4649f48e83644370bcd0a365a468744f/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:03:06.706765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045cea4-30bf-4f2a-9f8c-a5c953f606e4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:06.707444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045cea4-30bf-4f2a-9f8c-a5c953f606e4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:06.707980 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045cea4-30bf-4f2a-9f8c-a5c953f606e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:06.743085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9045cea4-30bf-4f2a-9f8c-a5c953f606e4 None None] MFA Rules not processed for user `4649f48e83644370bcd0a365a468744f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:06.744557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9045cea4-30bf-4f2a-9f8c-a5c953f606e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:06.852086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1267/2535] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:03:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:03:06.883610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ccd02-a1ef-446f-b039-45ff4f51c40a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:06.888424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b62ccd02-a1ef-446f-b039-45ff4f51c40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:06.979464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ccd02-a1ef-446f-b039-45ff4f51c40a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:06.983824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9b41e-b9e6-4e73-931a-2cac4ffdaeff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:06.984615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9b41e-b9e6-4e73-931a-2cac4ffdaeff service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:06.984956 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9b41e-b9e6-4e73-931a-2cac4ffdaeff service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:06.986329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9b41e-b9e6-4e73-931a-2cac4ffdaeff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:06.996237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9b41e-b9e6-4e73-931a-2cac4ffdaeff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:06.997813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9b41e-b9e6-4e73-931a-2cac4ffdaeff service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:07.009256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1269/2536] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:03:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:03:07.901902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045cea4-30bf-4f2a-9f8c-a5c953f606e4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:07.903556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9045cea4-30bf-4f2a-9f8c-a5c953f606e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:07.983594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:07.992186 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045cea4-30bf-4f2a-9f8c-a5c953f606e4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:07.997009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f330d94-8b70-4300-979f-3ab1973fb702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:07.997572 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae53f3-31e5-442e-9fe3-fecd83612d8d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:07.998290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f330d94-8b70-4300-979f-3ab1973fb702 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:07.998403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae53f3-31e5-442e-9fe3-fecd83612d8d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:07.998504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f330d94-8b70-4300-979f-3ab1973fb702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:07.998504 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f330d94-8b70-4300-979f-3ab1973fb702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:07.998842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae53f3-31e5-442e-9fe3-fecd83612d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:08.000210 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0f330d94-8b70-4300-979f-3ab1973fb702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:08.023050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6dae53f3-31e5-442e-9fe3-fecd83612d8d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:08.024354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6dae53f3-31e5-442e-9fe3-fecd83612d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:08.085267 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f330d94-8b70-4300-979f-3ab1973fb702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:08.086834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f330d94-8b70-4300-979f-3ab1973fb702 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:08.099279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1268/2537] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:03:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:03:08.125081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1270/2538] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:03:08.211014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f330d94-8b70-4300-979f-3ab1973fb702 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:08.212836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0f330d94-8b70-4300-979f-3ab1973fb702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:08.317697 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f330d94-8b70-4300-979f-3ab1973fb702 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:08.325809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dcba2-7d28-4d19-b58c-b26975b82c2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:08.326668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dcba2-7d28-4d19-b58c-b26975b82c2a service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:08.327062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dcba2-7d28-4d19-b58c-b26975b82c2a service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:08.327475 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dcba2-7d28-4d19-b58c-b26975b82c2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:08.339783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dcba2-7d28-4d19-b58c-b26975b82c2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:08.341577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dcba2-7d28-4d19-b58c-b26975b82c2a service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:08.354917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1269/2539] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:03:09.914470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae53f3-31e5-442e-9fe3-fecd83612d8d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:09.931344 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae53f3-31e5-442e-9fe3-fecd83612d8d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:09.940852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:09.942246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:09.942844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:09.943327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] PATH_INFO: `/v3/users/4649f48e83644370bcd0a365a468744f` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:09.944929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4649f48e83644370bcd0a365a468744f)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:09.947241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:09.963004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:10.022969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4649f48e83644370bcd0a365a468744f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:10.045229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4649f48e83644370bcd0a365a468744f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:10.046596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4649f48e83644370bcd0a365a468744f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:10.061976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4649f48e83644370bcd0a365a468744f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:10.063899 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4649f48e83644370bcd0a365a468744f'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:10.098383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1271/2540] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:03:09 2022] DELETE /identity/v3/users/4649f48e83644370bcd0a365a468744f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:03:10.105650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134ff4-c688-4699-a820-cd31e5e20222 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:10.106532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134ff4-c688-4699-a820-cd31e5e20222 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:10.106693 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134ff4-c688-4699-a820-cd31e5e20222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:10.142237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-05134ff4-c688-4699-a820-cd31e5e20222 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:10.144214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-05134ff4-c688-4699-a820-cd31e5e20222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:10.249962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1270/2541] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:03:10.262999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:10.266882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:10.446762 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73471dd0-2c88-48d4-aac3-bf0a74eb2d66 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:10.458370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc435aa-b9c5-4042-8f19-fdc704bc7b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:10.460135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc435aa-b9c5-4042-8f19-fdc704bc7b41 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:10.460449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc435aa-b9c5-4042-8f19-fdc704bc7b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:10.462049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc435aa-b9c5-4042-8f19-fdc704bc7b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:10.483152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc435aa-b9c5-4042-8f19-fdc704bc7b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:10.486153 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc435aa-b9c5-4042-8f19-fdc704bc7b41 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:10.507087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1272/2542] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:03:11.095366 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05134ff4-c688-4699-a820-cd31e5e20222 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:11.097973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-05134ff4-c688-4699-a820-cd31e5e20222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:11.120246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05134ff4-c688-4699-a820-cd31e5e20222 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:11.128081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:11.129841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:11.130270 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:11.130650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] PATH_INFO: `/v3/projects/1ebfd91a71ec407f821f0fa2a1b75be7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:11.132707 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ebfd91a71ec407f821f0fa2a1b75be7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:11.135009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:11.162859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:11.221505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebfd91a71ec407f821f0fa2a1b75be7', 'request_id': 'req-73557429-0ad3-4802-9f41-b07bd6042d39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:11.239204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebfd91a71ec407f821f0fa2a1b75be7', 'request_id': 'req-73557429-0ad3-4802-9f41-b07bd6042d39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:11.260514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebfd91a71ec407f821f0fa2a1b75be7', 'request_id': 'req-73557429-0ad3-4802-9f41-b07bd6042d39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:11.290045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] The token cache is being invalidate because project 1ebfd91a71ec407f821f0fa2a1b75be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:03:11.290716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:11.292068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-73557429-0ad3-4802-9f41-b07bd6042d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:11.300481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1271/2543] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:03:11 2022] DELETE /identity/v3/projects/1ebfd91a71ec407f821f0fa2a1b75be7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:03:11.309373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f93a43-49d0-4750-abae-74444cb56b94 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:11.310085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f93a43-49d0-4750-abae-74444cb56b94 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:11.311314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f93a43-49d0-4750-abae-74444cb56b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:11.350703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-d5f93a43-49d0-4750-abae-74444cb56b94 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:11.353424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d5f93a43-49d0-4750-abae-74444cb56b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:11.513290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1273/2544] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:03:11.517537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ada0d2-e3b1-475f-ab15-dabce662112d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:11.517537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ada0d2-e3b1-475f-ab15-dabce662112d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:11.518512 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ada0d2-e3b1-475f-ab15-dabce662112d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:11.565781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-03ada0d2-e3b1-475f-ab15-dabce662112d None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:11.567650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-03ada0d2-e3b1-475f-ab15-dabce662112d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:11.596677 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1272/2545] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:03:11.601608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f93a43-49d0-4750-abae-74444cb56b94 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:11.622910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f93a43-49d0-4750-abae-74444cb56b94 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:11.645540 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcd00c-0cd0-4874-96ae-66a0b5bcc3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:11.646722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd00c-0cd0-4874-96ae-66a0b5bcc3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:11.647263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd00c-0cd0-4874-96ae-66a0b5bcc3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:11.647756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcd00c-0cd0-4874-96ae-66a0b5bcc3e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:11.649105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcd00c-0cd0-4874-96ae-66a0b5bcc3e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:03:11.649654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcd00c-0cd0-4874-96ae-66a0b5bcc3e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:11.663589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcd00c-0cd0-4874-96ae-66a0b5bcc3e5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:11.714433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1274/2546] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:03:11.720450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ada0d2-e3b1-475f-ab15-dabce662112d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:11.741047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ada0d2-e3b1-475f-ab15-dabce662112d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:11.751849 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dfaa9-ee7d-435b-b60e-66cce022dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:11.753070 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dfaa9-ee7d-435b-b60e-66cce022dee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:11.753828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dfaa9-ee7d-435b-b60e-66cce022dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:11.754396 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dfaa9-ee7d-435b-b60e-66cce022dee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:11.756012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dfaa9-ee7d-435b-b60e-66cce022dee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:11.759033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dfaa9-ee7d-435b-b60e-66cce022dee8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:11.832351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1273/2547] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:03:11 2022] POST /identity/v3/projects => generated 397 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:03:11.837980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcd00c-0cd0-4874-96ae-66a0b5bcc3e5 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:11.860495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcd00c-0cd0-4874-96ae-66a0b5bcc3e5 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:11.900860 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:12.035811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848f86-9e1a-4434-932c-3e618839268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:12.042228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848f86-9e1a-4434-932c-3e618839268e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:12.042849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848f86-9e1a-4434-932c-3e618839268e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:12.043357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848f86-9e1a-4434-932c-3e618839268e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:12.044854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26848f86-9e1a-4434-932c-3e618839268e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:12.049038 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26848f86-9e1a-4434-932c-3e618839268e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:12.101960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1275/2548] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:03:11 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:03:12.108032 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dfaa9-ee7d-435b-b60e-66cce022dee8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:12.129392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dfaa9-ee7d-435b-b60e-66cce022dee8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:12.139019 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6a582-6497-4a1f-9e4f-b4cd60c16ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:12.140764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6a582-6497-4a1f-9e4f-b4cd60c16ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:12.141400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6a582-6497-4a1f-9e4f-b4cd60c16ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:12.142296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6a582-6497-4a1f-9e4f-b4cd60c16ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:12.144101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6a582-6497-4a1f-9e4f-b4cd60c16ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:12.153486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6a582-6497-4a1f-9e4f-b4cd60c16ffa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:12.169391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1274/2549] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:03:12.176204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848f86-9e1a-4434-932c-3e618839268e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:12.189843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848f86-9e1a-4434-932c-3e618839268e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:12.198932 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60847c-7650-47cd-bba0-e4a4f9677184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:12.200788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60847c-7650-47cd-bba0-e4a4f9677184 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:12.203013 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60847c-7650-47cd-bba0-e4a4f9677184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:12.203514 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60847c-7650-47cd-bba0-e4a4f9677184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:12.204888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60847c-7650-47cd-bba0-e4a4f9677184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:12.206383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60847c-7650-47cd-bba0-e4a4f9677184 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:12.228429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1276/2550] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:03:12.238920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6a582-6497-4a1f-9e4f-b4cd60c16ffa admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:12.256258 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6a582-6497-4a1f-9e4f-b4cd60c16ffa admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:12.265587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583dc32-293d-48ae-9364-96100ffb5dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:12.268797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583dc32-293d-48ae-9364-96100ffb5dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:12.269608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583dc32-293d-48ae-9364-96100ffb5dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:12.270910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583dc32-293d-48ae-9364-96100ffb5dad admin admin] PATH_INFO: `/v3/projects/e56ee615df6241ee838b98c120d693fe/users/0bb7455e981c488b81c4414c1bde0edd/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:12.311672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583dc32-293d-48ae-9364-96100ffb5dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56ee615df6241ee838b98c120d693fe, user_id=0bb7455e981c488b81c4414c1bde0edd, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:12.316147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583dc32-293d-48ae-9364-96100ffb5dad admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:12.363078 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1275/2551] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:03:12 2022] PUT /identity/v3/projects/e56ee615df6241ee838b98c120d693fe/users/0bb7455e981c488b81c4414c1bde0edd/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:03:12.382991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467755d-863a-413f-9bad-88d048c12af2 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:12.383804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467755d-863a-413f-9bad-88d048c12af2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:12.383804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467755d-863a-413f-9bad-88d048c12af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:12.460818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1467755d-863a-413f-9bad-88d048c12af2 None None] MFA Rules not processed for user `0bb7455e981c488b81c4414c1bde0edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:12.464447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1467755d-863a-413f-9bad-88d048c12af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:12.622906 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1277/2552] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:03:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:03:12.634920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583dc32-293d-48ae-9364-96100ffb5dad admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:12.638008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e583dc32-293d-48ae-9364-96100ffb5dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:12.777224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583dc32-293d-48ae-9364-96100ffb5dad admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:12.795363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7678ed-25d4-4a2a-afff-4076c92954e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:12.796953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7678ed-25d4-4a2a-afff-4076c92954e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:12.800378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7678ed-25d4-4a2a-afff-4076c92954e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:12.801335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7678ed-25d4-4a2a-afff-4076c92954e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:12.826023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7678ed-25d4-4a2a-afff-4076c92954e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:12.830177 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7678ed-25d4-4a2a-afff-4076c92954e5 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:12.852152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1276/2553] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:03:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:03:13.156113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ffb1-7ed3-4aa8-b2a4-3ee298dc9ed7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:13.156600 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ffb1-7ed3-4aa8-b2a4-3ee298dc9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:13.157262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ffb1-7ed3-4aa8-b2a4-3ee298dc9ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:13.185093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-df12ffb1-7ed3-4aa8-b2a4-3ee298dc9ed7 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:13.186384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-df12ffb1-7ed3-4aa8-b2a4-3ee298dc9ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:13.312277 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1278/2554] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:03:13.558470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7678ed-25d4-4a2a-afff-4076c92954e5 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:13.560573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5c7678ed-25d4-4a2a-afff-4076c92954e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:13.687989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:13.786200 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7678ed-25d4-4a2a-afff-4076c92954e5 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:13.797577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a3e48-feb9-45b4-971c-f6417a030010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:13.800899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a3e48-feb9-45b4-971c-f6417a030010 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:13.800899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a3e48-feb9-45b4-971c-f6417a030010 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:13.800899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a3e48-feb9-45b4-971c-f6417a030010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:13.822708 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a3e48-feb9-45b4-971c-f6417a030010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:13.826457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a3e48-feb9-45b4-971c-f6417a030010 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:13.851884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1277/2555] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:03:18.521342 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12ffb1-7ed3-4aa8-b2a4-3ee298dc9ed7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:18.533292 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12ffb1-7ed3-4aa8-b2a4-3ee298dc9ed7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:18.539930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:18.540690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242deb-bcba-46ba-aca9-b9a75d509334 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:18.541431 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:18.541594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242deb-bcba-46ba-aca9-b9a75d509334 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:18.541751 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:18.541967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242deb-bcba-46ba-aca9-b9a75d509334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:18.542127 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] PATH_INFO: `/v3/users/0bb7455e981c488b81c4414c1bde0edd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:18.543284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb7455e981c488b81c4414c1bde0edd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:18.545722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:18.570535 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-90242deb-bcba-46ba-aca9-b9a75d509334 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:18.572361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-90242deb-bcba-46ba-aca9-b9a75d509334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:18.583921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1278/2556] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:03:18.592672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:18.625263 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242deb-bcba-46ba-aca9-b9a75d509334 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:18.628304 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-90242deb-bcba-46ba-aca9-b9a75d509334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:18.635747 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb7455e981c488b81c4414c1bde0edd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:18.648387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242deb-bcba-46ba-aca9-b9a75d509334 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:18.654723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb7455e981c488b81c4414c1bde0edd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:18.655651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c00459-0fec-43b5-8ee0-738cabe4d5ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:18.656039 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb7455e981c488b81c4414c1bde0edd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:18.657724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c00459-0fec-43b5-8ee0-738cabe4d5ec service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:18.658029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c00459-0fec-43b5-8ee0-738cabe4d5ec service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:18.658318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c00459-0fec-43b5-8ee0-738cabe4d5ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:18.665845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb7455e981c488b81c4414c1bde0edd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:18.666622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb7455e981c488b81c4414c1bde0edd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:18.669782 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c00459-0fec-43b5-8ee0-738cabe4d5ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:18.672046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c00459-0fec-43b5-8ee0-738cabe4d5ec service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:18.689581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1279/2557] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:03:18.692112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1279/2558] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:03:18 2022] DELETE /identity/v3/users/0bb7455e981c488b81c4414c1bde0edd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:03:18.700441 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685db6-6bce-4a18-a647-45688dd8b204 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:18.700944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685db6-6bce-4a18-a647-45688dd8b204 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:18.701426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685db6-6bce-4a18-a647-45688dd8b204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:18.735801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f2685db6-6bce-4a18-a647-45688dd8b204 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:18.738552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2685db6-6bce-4a18-a647-45688dd8b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:18.857074 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1280/2559] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:03:18.869522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:18.871316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:18.973991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5732a42-0872-4f5b-95b0-9b8c383c8f04 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:18.979231 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6d5e9-1877-45f5-bde3-d44ffb8c038d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:18.980107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6d5e9-1877-45f5-bde3-d44ffb8c038d service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:18.980497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6d5e9-1877-45f5-bde3-d44ffb8c038d service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:18.980850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6d5e9-1877-45f5-bde3-d44ffb8c038d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:18.996083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6d5e9-1877-45f5-bde3-d44ffb8c038d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:18.998788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6d5e9-1877-45f5-bde3-d44ffb8c038d service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:19.014520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1280/2560] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:03:19.479598 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2685db6-6bce-4a18-a647-45688dd8b204 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:19.480875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2685db6-6bce-4a18-a647-45688dd8b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:19.497206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2685db6-6bce-4a18-a647-45688dd8b204 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:19.504577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:19.505793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:19.519898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:19.520523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] PATH_INFO: `/v3/projects/e56ee615df6241ee838b98c120d693fe` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:19.524543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56ee615df6241ee838b98c120d693fe)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:19.533970 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:19.617121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56ee615df6241ee838b98c120d693fe', 'request_id': 'req-56564320-ee60-4851-9050-696f40ccabd4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:19.627825 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56ee615df6241ee838b98c120d693fe', 'request_id': 'req-56564320-ee60-4851-9050-696f40ccabd4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:19.636931 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56ee615df6241ee838b98c120d693fe', 'request_id': 'req-56564320-ee60-4851-9050-696f40ccabd4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:19.664744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] The token cache is being invalidate because project e56ee615df6241ee838b98c120d693fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:03:19.665253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:19.666087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56564320-ee60-4851-9050-696f40ccabd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:03:19.668118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1281/2561] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:03:19 2022] DELETE /identity/v3/projects/e56ee615df6241ee838b98c120d693fe => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:03:29.008368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=7,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:29.656602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:40.191155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27e666-441d-4291-bc73-64d627a989f3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:40.192086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27e666-441d-4291-bc73-64d627a989f3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:40.192086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27e666-441d-4291-bc73-64d627a989f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:40.214360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-aa27e666-441d-4291-bc73-64d627a989f3 None None] MFA Rules not processed for user `976e351a35664c858fbe8892327bfb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:40.215667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-aa27e666-441d-4291-bc73-64d627a989f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:40.293053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1281/2562] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:03:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:03:50.285590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=25 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:03:56.392286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bec72e-19f7-4053-8dc6-fab87938a3fe None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:56.393092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bec72e-19f7-4053-8dc6-fab87938a3fe None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:56.393092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bec72e-19f7-4053-8dc6-fab87938a3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:56.415054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a7bec72e-19f7-4053-8dc6-fab87938a3fe None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:03:56.416645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a7bec72e-19f7-4053-8dc6-fab87938a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:56.493487 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1282/2563] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:03:56.531576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27e666-441d-4291-bc73-64d627a989f3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:03:56.533169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-aa27e666-441d-4291-bc73-64d627a989f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:03:56.648249 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27e666-441d-4291-bc73-64d627a989f3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:03:56.654043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90af9c-a5b2-487c-b62b-fca1178bd146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:03:56.654723 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90af9c-a5b2-487c-b62b-fca1178bd146 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:03:56.655014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90af9c-a5b2-487c-b62b-fca1178bd146 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:03:56.655358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90af9c-a5b2-487c-b62b-fca1178bd146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:03:56.665422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90af9c-a5b2-487c-b62b-fca1178bd146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:03:56.667227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90af9c-a5b2-487c-b62b-fca1178bd146 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:03:56.679936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1282/2564] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:04:00.834508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8406-aba4-48cb-907b-af54b3614535 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:00.835357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8406-aba4-48cb-907b-af54b3614535 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:00.835357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8406-aba4-48cb-907b-af54b3614535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:00.856035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-962c8406-aba4-48cb-907b-af54b3614535 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:04:00.857459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-962c8406-aba4-48cb-907b-af54b3614535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:00.866895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1283/2565] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:04:00.898464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90af9c-a5b2-487c-b62b-fca1178bd146 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:00.911777 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90af9c-a5b2-487c-b62b-fca1178bd146 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:00.917721 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826af0cc-7cf6-4895-975b-cc6053522e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:00.918398 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af0cc-7cf6-4895-975b-cc6053522e09 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:00.918686 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af0cc-7cf6-4895-975b-cc6053522e09 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:00.918965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af0cc-7cf6-4895-975b-cc6053522e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:00.930607 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826af0cc-7cf6-4895-975b-cc6053522e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:00.932506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826af0cc-7cf6-4895-975b-cc6053522e09 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:00.948229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1283/2566] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:04:05.942112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8df68e-e64b-4e41-8d08-94fe30f39738 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:05.942798 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8df68e-e64b-4e41-8d08-94fe30f39738 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:05.943276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8df68e-e64b-4e41-8d08-94fe30f39738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:05.970991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7e8df68e-e64b-4e41-8d08-94fe30f39738 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:04:05.972955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7e8df68e-e64b-4e41-8d08-94fe30f39738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:05.984242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1284/2567] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:04:06.017816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826af0cc-7cf6-4895-975b-cc6053522e09 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:06.019503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-826af0cc-7cf6-4895-975b-cc6053522e09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:06.037677 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826af0cc-7cf6-4895-975b-cc6053522e09 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:06.044804 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1a6bb-a04c-4a69-852b-6895ea2fc47a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:06.045493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1a6bb-a04c-4a69-852b-6895ea2fc47a service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:06.045778 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1a6bb-a04c-4a69-852b-6895ea2fc47a service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:06.046865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1a6bb-a04c-4a69-852b-6895ea2fc47a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:06.059135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1a6bb-a04c-4a69-852b-6895ea2fc47a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:06.060805 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1a6bb-a04c-4a69-852b-6895ea2fc47a service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:06.085772 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1284/2568] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:04:09.221650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8df68e-e64b-4e41-8d08-94fe30f39738 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:09.223961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7e8df68e-e64b-4e41-8d08-94fe30f39738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:09.300328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8df68e-e64b-4e41-8d08-94fe30f39738 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:09.304639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1470c-58fd-422f-93a3-aa948f12e87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:09.305315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1470c-58fd-422f-93a3-aa948f12e87d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:09.305630 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1470c-58fd-422f-93a3-aa948f12e87d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:09.305909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1470c-58fd-422f-93a3-aa948f12e87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:09.307868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-94f1470c-58fd-422f-93a3-aa948f12e87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:09.324333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1470c-58fd-422f-93a3-aa948f12e87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:09.325843 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1470c-58fd-422f-93a3-aa948f12e87d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:09.340156 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1285/2569] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:04:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:04:10.164943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a080a7-871a-446e-94aa-227b82010504 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:10.165609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a080a7-871a-446e-94aa-227b82010504 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:10.165762 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a080a7-871a-446e-94aa-227b82010504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:10.186343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-37a080a7-871a-446e-94aa-227b82010504 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:04:10.187885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-37a080a7-871a-446e-94aa-227b82010504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:10.197830 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1285/2570] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:04:10.241769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1470c-58fd-422f-93a3-aa948f12e87d service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:10.255422 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1470c-58fd-422f-93a3-aa948f12e87d service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:10.261573 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c830-7b22-4a46-bc69-247e889e3d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:10.262306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c830-7b22-4a46-bc69-247e889e3d85 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:10.262720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c830-7b22-4a46-bc69-247e889e3d85 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:10.263053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c830-7b22-4a46-bc69-247e889e3d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:10.274178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c830-7b22-4a46-bc69-247e889e3d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:10.276047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c830-7b22-4a46-bc69-247e889e3d85 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:10.288544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1286/2571] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:04:14.198410 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a080a7-871a-446e-94aa-227b82010504 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:14.200162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-37a080a7-871a-446e-94aa-227b82010504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:14.217189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a080a7-871a-446e-94aa-227b82010504 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:14.222318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dedc4-469f-4887-a193-5ff823718469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:14.223199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dedc4-469f-4887-a193-5ff823718469 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:14.223595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dedc4-469f-4887-a193-5ff823718469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:14.223969 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dedc4-469f-4887-a193-5ff823718469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:14.226200 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-906dedc4-469f-4887-a193-5ff823718469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:14.242864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dedc4-469f-4887-a193-5ff823718469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:14.244390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dedc4-469f-4887-a193-5ff823718469 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:14.258351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1286/2572] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:04:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:04:14.423687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a83bc-8c66-4775-8f51-00a38cd91978 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:14.424543 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a83bc-8c66-4775-8f51-00a38cd91978 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:14.424856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a83bc-8c66-4775-8f51-00a38cd91978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:14.448035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-022a83bc-8c66-4775-8f51-00a38cd91978 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:04:14.449464 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-022a83bc-8c66-4775-8f51-00a38cd91978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:14.459184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1287/2573] 10.222.0.99 () {58 vars in 1016 bytes} [Tue Jun 21 16:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:04:14.496192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dedc4-469f-4887-a193-5ff823718469 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:14.509476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dedc4-469f-4887-a193-5ff823718469 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:14.516885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886366c1-1e42-4155-a2d1-7fff3082b516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:14.517561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886366c1-1e42-4155-a2d1-7fff3082b516 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:14.517855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886366c1-1e42-4155-a2d1-7fff3082b516 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:14.518136 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886366c1-1e42-4155-a2d1-7fff3082b516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:14.528063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886366c1-1e42-4155-a2d1-7fff3082b516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:14.529867 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886366c1-1e42-4155-a2d1-7fff3082b516 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:14.544538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1287/2574] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:04:24.442038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=68 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:24.536402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=61 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:33.885456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571f28-76e5-4ba6-a992-f560304b06c1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:33.886544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571f28-76e5-4ba6-a992-f560304b06c1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:33.886544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571f28-76e5-4ba6-a992-f560304b06c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:33.907985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-43571f28-76e5-4ba6-a992-f560304b06c1 None None] MFA Rules not processed for user `74f447686a3a41ef8300b20c04c9776a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:04:33.909346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-43571f28-76e5-4ba6-a992-f560304b06c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:34.018696 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1288/2575] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:04:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:04:38.134460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886366c1-1e42-4155-a2d1-7fff3082b516 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:38.159073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886366c1-1e42-4155-a2d1-7fff3082b516 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:38.167460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5fd2f-6d01-42a6-8b72-805c0f5da89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:38.168662 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5fd2f-6d01-42a6-8b72-805c0f5da89c service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:38.169004 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5fd2f-6d01-42a6-8b72-805c0f5da89c service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:38.170000 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5fd2f-6d01-42a6-8b72-805c0f5da89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:38.173318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-24c5fd2f-6d01-42a6-8b72-805c0f5da89c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:38.187429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5fd2f-6d01-42a6-8b72-805c0f5da89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:38.189147 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5fd2f-6d01-42a6-8b72-805c0f5da89c service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:38.207254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1288/2576] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:04:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:04:43.997845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=25 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:48.195439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:48.621852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571f28-76e5-4ba6-a992-f560304b06c1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:48.640739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571f28-76e5-4ba6-a992-f560304b06c1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:48.647341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda8e7-e855-404f-8f23-89eabd9f2280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:48.648821 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda8e7-e855-404f-8f23-89eabd9f2280 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:48.649184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda8e7-e855-404f-8f23-89eabd9f2280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:48.649753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda8e7-e855-404f-8f23-89eabd9f2280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:48.652251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-16cda8e7-e855-404f-8f23-89eabd9f2280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:48.674151 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cda8e7-e855-404f-8f23-89eabd9f2280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:48.677164 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cda8e7-e855-404f-8f23-89eabd9f2280 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:48.693175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1289/2577] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:04:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:04:51.471250 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5fd2f-6d01-42a6-8b72-805c0f5da89c service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:51.473052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-24c5fd2f-6d01-42a6-8b72-805c0f5da89c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:51.562880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda8e7-e855-404f-8f23-89eabd9f2280 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:51.567153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-16cda8e7-e855-404f-8f23-89eabd9f2280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:51.599621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5fd2f-6d01-42a6-8b72-805c0f5da89c service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:51.604251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda8e7-e855-404f-8f23-89eabd9f2280 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:51.610365 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:51.611195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526030b-d15c-4414-93b2-65596b8bbd9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:51.611420 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:51.611728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:51.612046 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] PATH_INFO: `/v3/users/976e351a35664c858fbe8892327bfb54` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:51.612343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526030b-d15c-4414-93b2-65596b8bbd9d service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:51.612865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526030b-d15c-4414-93b2-65596b8bbd9d service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:51.613330 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] RBAC: Authorizing `identity:delete_user(user_id=976e351a35664c858fbe8892327bfb54)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:51.613509 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526030b-d15c-4414-93b2-65596b8bbd9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:51.615446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:51.616818 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b526030b-d15c-4414-93b2-65596b8bbd9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:51.649411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526030b-d15c-4414-93b2-65596b8bbd9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:51.652719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526030b-d15c-4414-93b2-65596b8bbd9d service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:51.676304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1289/2578] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:04:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:04:51.699071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976e351a35664c858fbe8892327bfb54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:04:51.727841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976e351a35664c858fbe8892327bfb54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:04:51.740029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976e351a35664c858fbe8892327bfb54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:04:51.741440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976e351a35664c858fbe8892327bfb54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:04:51.758125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11644038-d6a5-435b-8701-51b920d3fdee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976e351a35664c858fbe8892327bfb54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:04:51.772530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1290/2579] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:04:51 2022] DELETE /identity/v3/users/976e351a35664c858fbe8892327bfb54 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:04:52.089646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526030b-d15c-4414-93b2-65596b8bbd9d service placement] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:52.117583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526030b-d15c-4414-93b2-65596b8bbd9d service placement] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:52.235461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:52.237007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:52.237588 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:52.238102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] PATH_INFO: `/v3/projects/e3053ece51d24388a8b49ad68543419b` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:52.240439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3053ece51d24388a8b49ad68543419b)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:52.244373 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:52.328602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3053ece51d24388a8b49ad68543419b', 'request_id': 'req-f3882bf6-a57f-4c49-a612-2ffe100f0599'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:04:52.337112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3053ece51d24388a8b49ad68543419b', 'request_id': 'req-f3882bf6-a57f-4c49-a612-2ffe100f0599'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:04:52.346883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3053ece51d24388a8b49ad68543419b', 'request_id': 'req-f3882bf6-a57f-4c49-a612-2ffe100f0599'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:04:52.362853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] The token cache is being invalidate because project e3053ece51d24388a8b49ad68543419b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:04:52.363230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:04:52.364171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f3882bf6-a57f-4c49-a612-2ffe100f0599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:04:52.366573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1290/2580] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:04:52 2022] DELETE /identity/v3/projects/e3053ece51d24388a8b49ad68543419b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:04:52.373390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed587-8113-450b-9bad-1dbf9eeeae2b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:52.373859 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed587-8113-450b-9bad-1dbf9eeeae2b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:52.374334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed587-8113-450b-9bad-1dbf9eeeae2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:52.394929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-405ed587-8113-450b-9bad-1dbf9eeeae2b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:04:52.396311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-405ed587-8113-450b-9bad-1dbf9eeeae2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:52.487076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1291/2581] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:04:52.500976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d47c09-1f76-41ec-a540-4e6d3ca33a29 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:52.501813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d47c09-1f76-41ec-a540-4e6d3ca33a29 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:52.501988 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d47c09-1f76-41ec-a540-4e6d3ca33a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:52.535939 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-26d47c09-1f76-41ec-a540-4e6d3ca33a29 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:04:52.538422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-26d47c09-1f76-41ec-a540-4e6d3ca33a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:52.557788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1291/2582] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:04:52.563556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ed587-8113-450b-9bad-1dbf9eeeae2b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:52.576293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ed587-8113-450b-9bad-1dbf9eeeae2b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:52.584230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa016e8e-9949-4bba-bd84-d25fd77bbdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:52.585392 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa016e8e-9949-4bba-bd84-d25fd77bbdaa admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:52.585914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa016e8e-9949-4bba-bd84-d25fd77bbdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:52.586438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa016e8e-9949-4bba-bd84-d25fd77bbdaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:52.587967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa016e8e-9949-4bba-bd84-d25fd77bbdaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:04:52.588539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa016e8e-9949-4bba-bd84-d25fd77bbdaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:52.591784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa016e8e-9949-4bba-bd84-d25fd77bbdaa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:52.616510 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1292/2583] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:04:52.621740 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d47c09-1f76-41ec-a540-4e6d3ca33a29 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:52.634831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d47c09-1f76-41ec-a540-4e6d3ca33a29 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:52.641376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6f5ad-86ea-48ea-8660-b4462b7c5929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:52.642381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f5ad-86ea-48ea-8660-b4462b7c5929 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:52.642815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f5ad-86ea-48ea-8660-b4462b7c5929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:52.643304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6f5ad-86ea-48ea-8660-b4462b7c5929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:52.644568 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6f5ad-86ea-48ea-8660-b4462b7c5929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:52.646919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6f5ad-86ea-48ea-8660-b4462b7c5929 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:52.660813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:52.704821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1292/2584] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:04:52 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:04:52.706266 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa016e8e-9949-4bba-bd84-d25fd77bbdaa admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:52.718452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa016e8e-9949-4bba-bd84-d25fd77bbdaa admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:52.778576 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:52.798728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf9a1-974f-4119-a251-8f2816ad4f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:52.799627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf9a1-974f-4119-a251-8f2816ad4f44 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:52.799927 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf9a1-974f-4119-a251-8f2816ad4f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:52.800325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf9a1-974f-4119-a251-8f2816ad4f44 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:52.801062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf9a1-974f-4119-a251-8f2816ad4f44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:52.803128 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf9a1-974f-4119-a251-8f2816ad4f44 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:52.828317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1293/2585] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:04:52 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:04:52.832980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6f5ad-86ea-48ea-8660-b4462b7c5929 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:52.846102 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6f5ad-86ea-48ea-8660-b4462b7c5929 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:52.851131 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8dc15-8ce4-4cbb-9d1f-8b01be75a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:52.851858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8dc15-8ce4-4cbb-9d1f-8b01be75a3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:52.852168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8dc15-8ce4-4cbb-9d1f-8b01be75a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:52.852437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8dc15-8ce4-4cbb-9d1f-8b01be75a3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:52.853190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8dc15-8ce4-4cbb-9d1f-8b01be75a3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:52.854849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8dc15-8ce4-4cbb-9d1f-8b01be75a3d4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:52.872528 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1293/2586] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:04:52.877575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf9a1-974f-4119-a251-8f2816ad4f44 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:52.890480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf9a1-974f-4119-a251-8f2816ad4f44 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:52.895853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870bbb3-30d0-45d6-b67e-4ed673f863d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:52.896556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870bbb3-30d0-45d6-b67e-4ed673f863d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:52.896852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870bbb3-30d0-45d6-b67e-4ed673f863d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:52.897180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870bbb3-30d0-45d6-b67e-4ed673f863d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:52.897954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870bbb3-30d0-45d6-b67e-4ed673f863d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:52.899809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870bbb3-30d0-45d6-b67e-4ed673f863d4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:52.912112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1294/2587] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:04:52.916974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8dc15-8ce4-4cbb-9d1f-8b01be75a3d4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:52.939150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8dc15-8ce4-4cbb-9d1f-8b01be75a3d4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:52.948173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56123-55cb-4fe6-b8fa-6376489dc9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:52.951446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56123-55cb-4fe6-b8fa-6376489dc9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:52.952287 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56123-55cb-4fe6-b8fa-6376489dc9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:52.953184 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56123-55cb-4fe6-b8fa-6376489dc9ea admin admin] PATH_INFO: `/v3/projects/e0e194c8baba46b5a1d9e6e895136378/users/ba7c04a2d03a40e59dc665bb747b3ece/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:52.977719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e56123-55cb-4fe6-b8fa-6376489dc9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e194c8baba46b5a1d9e6e895136378, user_id=ba7c04a2d03a40e59dc665bb747b3ece, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:52.983827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e56123-55cb-4fe6-b8fa-6376489dc9ea admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:53.007858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1294/2588] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:04:52 2022] PUT /identity/v3/projects/e0e194c8baba46b5a1d9e6e895136378/users/ba7c04a2d03a40e59dc665bb747b3ece/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:04:53.014736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2909bbb-ec6b-4333-a06d-549dc1d382c8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:53.015265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2909bbb-ec6b-4333-a06d-549dc1d382c8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:53.015621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2909bbb-ec6b-4333-a06d-549dc1d382c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:53.042941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d2909bbb-ec6b-4333-a06d-549dc1d382c8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:04:53.045104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d2909bbb-ec6b-4333-a06d-549dc1d382c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:53.125234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1295/2589] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:04:53.135266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56123-55cb-4fe6-b8fa-6376489dc9ea admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:53.137282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-51e56123-55cb-4fe6-b8fa-6376489dc9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:53.204863 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56123-55cb-4fe6-b8fa-6376489dc9ea admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:53.208694 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908938d0-3526-452a-8d72-04059c7a8817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:53.209385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908938d0-3526-452a-8d72-04059c7a8817 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:53.209679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908938d0-3526-452a-8d72-04059c7a8817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:53.209964 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908938d0-3526-452a-8d72-04059c7a8817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:53.221745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908938d0-3526-452a-8d72-04059c7a8817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:53.222846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908938d0-3526-452a-8d72-04059c7a8817 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:53.234868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1295/2590] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:04:59.135746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430412-a835-49d3-91b3-7e06e20348d5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:59.136493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430412-a835-49d3-91b3-7e06e20348d5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:59.136493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430412-a835-49d3-91b3-7e06e20348d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:59.182450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0b430412-a835-49d3-91b3-7e06e20348d5 None None] MFA Rules not processed for user `ba7c04a2d03a40e59dc665bb747b3ece`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:04:59.186893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b430412-a835-49d3-91b3-7e06e20348d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:04:59.304036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1296/2591] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:04:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:04:59.311349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908938d0-3526-452a-8d72-04059c7a8817 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:59.331426 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908938d0-3526-452a-8d72-04059c7a8817 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:59.340537 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c82d-ac48-40a3-a0d6-565b0f189dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:59.341875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c82d-ac48-40a3-a0d6-565b0f189dbd admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:59.342383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c82d-ac48-40a3-a0d6-565b0f189dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:59.342764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c82d-ac48-40a3-a0d6-565b0f189dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:59.344105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623c82d-ac48-40a3-a0d6-565b0f189dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:59.347934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623c82d-ac48-40a3-a0d6-565b0f189dbd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:59.395229 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1296/2592] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:04:59 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:04:59.401749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b430412-a835-49d3-91b3-7e06e20348d5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:59.424577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b430412-a835-49d3-91b3-7e06e20348d5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:59.520014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:04:59.530581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a3fc2-0721-41f6-9c72-1f02634ee707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:59.531664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a3fc2-0721-41f6-9c72-1f02634ee707 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:59.532233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a3fc2-0721-41f6-9c72-1f02634ee707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:59.532556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a3fc2-0721-41f6-9c72-1f02634ee707 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:59.533312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a3fc2-0721-41f6-9c72-1f02634ee707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:59.535400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a3fc2-0721-41f6-9c72-1f02634ee707 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:59.564117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1297/2593] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:04:59 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:04:59.568436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c82d-ac48-40a3-a0d6-565b0f189dbd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:59.580971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c82d-ac48-40a3-a0d6-565b0f189dbd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:59.586559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224834b-5f71-42f2-b3d1-90f956f26b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:59.587187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224834b-5f71-42f2-b3d1-90f956f26b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:59.587475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224834b-5f71-42f2-b3d1-90f956f26b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:59.587756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224834b-5f71-42f2-b3d1-90f956f26b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:59.588511 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224834b-5f71-42f2-b3d1-90f956f26b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:59.590185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224834b-5f71-42f2-b3d1-90f956f26b43 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:59.603396 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1297/2594] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:04:59.610318 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a3fc2-0721-41f6-9c72-1f02634ee707 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:59.626435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a3fc2-0721-41f6-9c72-1f02634ee707 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:59.631985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438878e-1375-4e45-9cb7-1a3703257f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:59.633372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438878e-1375-4e45-9cb7-1a3703257f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:59.633372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438878e-1375-4e45-9cb7-1a3703257f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:59.633717 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438878e-1375-4e45-9cb7-1a3703257f94 admin admin] PATH_INFO: `/v3/projects/29ecae8aed0c442e97bcc9498cf4d127/users/533f9f262d2445ed83b6c0aaceae8f2e/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:59.655397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438878e-1375-4e45-9cb7-1a3703257f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ecae8aed0c442e97bcc9498cf4d127, user_id=533f9f262d2445ed83b6c0aaceae8f2e, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:59.658705 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438878e-1375-4e45-9cb7-1a3703257f94 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:59.674541 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1298/2595] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:04:59 2022] PUT /identity/v3/projects/29ecae8aed0c442e97bcc9498cf4d127/users/533f9f262d2445ed83b6c0aaceae8f2e/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:04:59.679324 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224834b-5f71-42f2-b3d1-90f956f26b43 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:59.690628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224834b-5f71-42f2-b3d1-90f956f26b43 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:59.757378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e3879-d858-4ced-91f7-5b39b834e988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:59.758075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e3879-d858-4ced-91f7-5b39b834e988 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:59.758366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e3879-d858-4ced-91f7-5b39b834e988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:59.758649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e3879-d858-4ced-91f7-5b39b834e988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:59.759435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e3879-d858-4ced-91f7-5b39b834e988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:59.761088 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e3879-d858-4ced-91f7-5b39b834e988 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:59.773254 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1298/2596] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:04:59.779142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438878e-1375-4e45-9cb7-1a3703257f94 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:04:59.791333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438878e-1375-4e45-9cb7-1a3703257f94 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:04:59.797831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff4450-ae75-45c1-93c6-31516844d654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:04:59.798961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff4450-ae75-45c1-93c6-31516844d654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:04:59.799449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff4450-ae75-45c1-93c6-31516844d654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:04:59.799881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff4450-ae75-45c1-93c6-31516844d654 admin admin] PATH_INFO: `/v3/projects/29ecae8aed0c442e97bcc9498cf4d127/users/533f9f262d2445ed83b6c0aaceae8f2e/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:04:59.802363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff4450-ae75-45c1-93c6-31516844d654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ecae8aed0c442e97bcc9498cf4d127, user_id=533f9f262d2445ed83b6c0aaceae8f2e, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:04:59.805526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff4450-ae75-45c1-93c6-31516844d654 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:04:59.819064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1299/2597] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:04:59 2022] PUT /identity/v3/projects/29ecae8aed0c442e97bcc9498cf4d127/users/533f9f262d2445ed83b6c0aaceae8f2e/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:05:05.860886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbee03-ca78-48be-8f77-dd60d542b947 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:05.861629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbee03-ca78-48be-8f77-dd60d542b947 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:05.861841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbee03-ca78-48be-8f77-dd60d542b947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:05.938716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:05.947035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e8fbee03-ca78-48be-8f77-dd60d542b947 None None] MFA Rules not processed for user `533f9f262d2445ed83b6c0aaceae8f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:05:05.954020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e8fbee03-ca78-48be-8f77-dd60d542b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:06.171281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1299/2598] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:05:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:05:06.194499 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff4450-ae75-45c1-93c6-31516844d654 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:06.199093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-60ff4450-ae75-45c1-93c6-31516844d654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:06.377574 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff4450-ae75-45c1-93c6-31516844d654 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:06.384789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ffced-ab63-4666-be05-d79e1d80e67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:06.385552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ffced-ab63-4666-be05-d79e1d80e67e service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:06.385949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ffced-ab63-4666-be05-d79e1d80e67e service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:06.386339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ffced-ab63-4666-be05-d79e1d80e67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:06.495279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ffced-ab63-4666-be05-d79e1d80e67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:06.497910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ffced-ab63-4666-be05-d79e1d80e67e service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:06.514106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1300/2599] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:05:09.066485 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88896-a320-4b45-af43-0818eb119acf None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:09.067238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88896-a320-4b45-af43-0818eb119acf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:09.067760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88896-a320-4b45-af43-0818eb119acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:09.100612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-98b88896-a320-4b45-af43-0818eb119acf None None] MFA Rules not processed for user `ba7c04a2d03a40e59dc665bb747b3ece`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:05:09.103444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-98b88896-a320-4b45-af43-0818eb119acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:09.116050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1300/2600] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:05:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:05:16.503806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:19.092639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=31 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:20.108157 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ffced-ab63-4666-be05-d79e1d80e67e service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:20.144336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ffced-ab63-4666-be05-d79e1d80e67e service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:20.163018 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6b069-6c87-46c4-8d30-137f28f86c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:20.165728 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6b069-6c87-46c4-8d30-137f28f86c23 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:20.166314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6b069-6c87-46c4-8d30-137f28f86c23 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:20.166843 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6b069-6c87-46c4-8d30-137f28f86c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:20.170176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dab6b069-6c87-46c4-8d30-137f28f86c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:20.201091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6b069-6c87-46c4-8d30-137f28f86c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:20.204124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6b069-6c87-46c4-8d30-137f28f86c23 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:20.232204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1301/2601] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:05:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:05:29.647569 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b88896-a320-4b45-af43-0818eb119acf None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:29.716455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b88896-a320-4b45-af43-0818eb119acf None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:29.721162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5a0c5-d888-4c0e-8fed-504fb0eb5e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:29.721837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5a0c5-d888-4c0e-8fed-504fb0eb5e37 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:29.722319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5a0c5-d888-4c0e-8fed-504fb0eb5e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:29.722604 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5a0c5-d888-4c0e-8fed-504fb0eb5e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:29.724664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-19f5a0c5-d888-4c0e-8fed-504fb0eb5e37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:29.737516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5a0c5-d888-4c0e-8fed-504fb0eb5e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:29.739126 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5a0c5-d888-4c0e-8fed-504fb0eb5e37 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:29.749503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1301/2602] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:05:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:05:30.218984 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:30.445641 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6b069-6c87-46c4-8d30-137f28f86c23 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:30.448061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dab6b069-6c87-46c4-8d30-137f28f86c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:30.586998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6b069-6c87-46c4-8d30-137f28f86c23 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:30.597968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e9edc-7b01-4c7c-94fd-891296ba73e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:30.598857 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9edc-7b01-4c7c-94fd-891296ba73e4 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:30.599350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9edc-7b01-4c7c-94fd-891296ba73e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:30.599766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9edc-7b01-4c7c-94fd-891296ba73e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:30.602297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-920e9edc-7b01-4c7c-94fd-891296ba73e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:30.625672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e9edc-7b01-4c7c-94fd-891296ba73e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:30.629206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e9edc-7b01-4c7c-94fd-891296ba73e4 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:30.646094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1302/2603] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:05:30.739589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5a0c5-d888-4c0e-8fed-504fb0eb5e37 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:30.756350 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5a0c5-d888-4c0e-8fed-504fb0eb5e37 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:30.763256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f332-42e4-48f3-8576-94579b6a735a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:30.763940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f332-42e4-48f3-8576-94579b6a735a service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:30.764232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f332-42e4-48f3-8576-94579b6a735a service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:30.764522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f332-42e4-48f3-8576-94579b6a735a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:30.766743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8a69f332-42e4-48f3-8576-94579b6a735a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:30.781358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69f332-42e4-48f3-8576-94579b6a735a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:30.782997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69f332-42e4-48f3-8576-94579b6a735a service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:30.796491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1302/2604] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:05:32.649223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176806-4937-4394-b9b3-ce8de3b34353 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:32.650038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176806-4937-4394-b9b3-ce8de3b34353 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:32.650038 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176806-4937-4394-b9b3-ce8de3b34353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:32.670961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8c176806-4937-4394-b9b3-ce8de3b34353 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:05:32.672374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8c176806-4937-4394-b9b3-ce8de3b34353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:32.767556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1303/2605] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jun 21 16:05:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:05:32.857975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f332-42e4-48f3-8576-94579b6a735a service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:32.860633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8a69f332-42e4-48f3-8576-94579b6a735a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:33.008140 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f332-42e4-48f3-8576-94579b6a735a service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:33.018765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8d14b-95bf-4a6a-924c-a4ea3b68a458 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:33.018765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8d14b-95bf-4a6a-924c-a4ea3b68a458 service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:33.019376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8d14b-95bf-4a6a-924c-a4ea3b68a458 service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:33.019647 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8d14b-95bf-4a6a-924c-a4ea3b68a458 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:33.033633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8d14b-95bf-4a6a-924c-a4ea3b68a458 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:33.036738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8d14b-95bf-4a6a-924c-a4ea3b68a458 service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:33.051965 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1303/2606] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:05:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:05:42.754436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=57 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:43.046361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=64 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:45.407921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c176806-4937-4394-b9b3-ce8de3b34353 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:45.423097 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c176806-4937-4394-b9b3-ce8de3b34353 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:45.433068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be336e-f547-496a-97b1-6d2add381e37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:45.434600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be336e-f547-496a-97b1-6d2add381e37 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:45.435112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be336e-f547-496a-97b1-6d2add381e37 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:45.435894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be336e-f547-496a-97b1-6d2add381e37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:45.439065 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-92be336e-f547-496a-97b1-6d2add381e37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:45.460726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be336e-f547-496a-97b1-6d2add381e37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:45.463674 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be336e-f547-496a-97b1-6d2add381e37 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:45.495746 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1304/2607] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:05:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:05:45.614160 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8d14b-95bf-4a6a-924c-a4ea3b68a458 service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:45.617923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-26c8d14b-95bf-4a6a-924c-a4ea3b68a458 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:45.774016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8d14b-95bf-4a6a-924c-a4ea3b68a458 service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:45.779934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:45.780853 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:45.781146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:45.781433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] PATH_INFO: `/v3/users/3c3dba1352544598a85b900195b64300` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:45.782764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3dba1352544598a85b900195b64300)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:45.784817 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:45.853752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3dba1352544598a85b900195b64300'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:45.878932 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3dba1352544598a85b900195b64300'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:45.881111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3dba1352544598a85b900195b64300'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:45.894973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3dba1352544598a85b900195b64300'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:45.895938 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3dba1352544598a85b900195b64300'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:45.914426 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1304/2608] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:05:45 2022] DELETE /identity/v3/users/3c3dba1352544598a85b900195b64300 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:05:46.156346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be336e-f547-496a-97b1-6d2add381e37 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:46.179610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be336e-f547-496a-97b1-6d2add381e37 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:46.280962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:46.282211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:46.282559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:46.282904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] PATH_INFO: `/v3/projects/aad1011bffba436c9d4c938ab6137c4d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:46.284614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad1011bffba436c9d4c938ab6137c4d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:46.286878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:46.369686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad1011bffba436c9d4c938ab6137c4d', 'request_id': 'req-aaf2a462-8957-47e8-ad87-8e89c5aba000'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:46.382364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad1011bffba436c9d4c938ab6137c4d', 'request_id': 'req-aaf2a462-8957-47e8-ad87-8e89c5aba000'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:46.393340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad1011bffba436c9d4c938ab6137c4d', 'request_id': 'req-aaf2a462-8957-47e8-ad87-8e89c5aba000'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:46.414276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] The token cache is being invalidate because project aad1011bffba436c9d4c938ab6137c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:05:46.415306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:46.416440 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:46.419261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1305/2609] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:05:46 2022] DELETE /identity/v3/projects/aad1011bffba436c9d4c938ab6137c4d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:05:46.425252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:46.427646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:46.450466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac247f-ada0-4d87-8215-d519daacf514 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:46.532836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:46.533865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:46.534149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:46.534432 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] PATH_INFO: `/v3/users/e3075db9329140b0a2c6b0c8b5657613` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:46.535845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3075db9329140b0a2c6b0c8b5657613)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:46.537877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:46.572789 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:46.617469 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3075db9329140b0a2c6b0c8b5657613'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:46.636450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3075db9329140b0a2c6b0c8b5657613'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:46.637784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3075db9329140b0a2c6b0c8b5657613'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:46.650291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3075db9329140b0a2c6b0c8b5657613'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:46.653605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3075db9329140b0a2c6b0c8b5657613'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:46.694404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1305/2610] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:05:46 2022] DELETE /identity/v3/users/e3075db9329140b0a2c6b0c8b5657613 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:05:46.743129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:46.747203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:46.928583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2a462-8957-47e8-ad87-8e89c5aba000 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:46.967703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:47.084732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:47.099675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:47.106373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded1d7c-e310-4a9e-ad21-64976feeac6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:47.107088 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1d7c-e310-4a9e-ad21-64976feeac6a service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:47.107351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1d7c-e310-4a9e-ad21-64976feeac6a service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:47.107618 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded1d7c-e310-4a9e-ad21-64976feeac6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:47.109869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8ded1d7c-e310-4a9e-ad21-64976feeac6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:47.124244 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded1d7c-e310-4a9e-ad21-64976feeac6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:47.126084 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded1d7c-e310-4a9e-ad21-64976feeac6a service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:47.139599 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1306/2611] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:05:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:05:47.255728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243f1ac-7d28-4ce5-89cd-9c233668bbc4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:47.262846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:47.263787 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:47.264077 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:47.264360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] PATH_INFO: `/v3/projects/d09f96aaa3254e8f8105636ab20a3b4a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:47.265856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09f96aaa3254e8f8105636ab20a3b4a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:47.271641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:47.342602 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09f96aaa3254e8f8105636ab20a3b4a', 'request_id': 'req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:47.348909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09f96aaa3254e8f8105636ab20a3b4a', 'request_id': 'req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:47.359484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09f96aaa3254e8f8105636ab20a3b4a', 'request_id': 'req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:47.374991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] The token cache is being invalidate because project d09f96aaa3254e8f8105636ab20a3b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:05:47.375357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:47.376087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c160d434-a6f1-44d6-9eb6-8cb4de2703cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:05:47.377762 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1306/2612] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:05:47 2022] DELETE /identity/v3/projects/d09f96aaa3254e8f8105636ab20a3b4a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:05:53.003333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded1d7c-e310-4a9e-ad21-64976feeac6a service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:53.004869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8ded1d7c-e310-4a9e-ad21-64976feeac6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:53.097175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded1d7c-e310-4a9e-ad21-64976feeac6a service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:53.177977 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cf1ea-406a-4e92-95e5-368c0bfa51b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:53.178854 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cf1ea-406a-4e92-95e5-368c0bfa51b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:53.179312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cf1ea-406a-4e92-95e5-368c0bfa51b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:53.179698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cf1ea-406a-4e92-95e5-368c0bfa51b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:53.181814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-396cf1ea-406a-4e92-95e5-368c0bfa51b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:53.268179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cf1ea-406a-4e92-95e5-368c0bfa51b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:53.270110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cf1ea-406a-4e92-95e5-368c0bfa51b8 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:53.296008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1307/2613] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:05:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:05:56.972898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21ffc-dc30-44f3-b8ce-dd1f43539754 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:56.973748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21ffc-dc30-44f3-b8ce-dd1f43539754 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:56.973748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21ffc-dc30-44f3-b8ce-dd1f43539754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:57.008940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-31b21ffc-dc30-44f3-b8ce-dd1f43539754 None None] MFA Rules not processed for user `96c9297b1a444ab189d73da643625270`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:05:57.011986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-31b21ffc-dc30-44f3-b8ce-dd1f43539754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:57.067144 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:57.124354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1307/2614] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:05:58.832199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cf1ea-406a-4e92-95e5-368c0bfa51b8 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:05:58.833753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-396cf1ea-406a-4e92-95e5-368c0bfa51b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:58.846831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cf1ea-406a-4e92-95e5-368c0bfa51b8 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:05:58.851434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e471cf4-23a6-4d81-b216-f44720eb85bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:05:58.852158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e471cf4-23a6-4d81-b216-f44720eb85bb service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:05:58.852484 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e471cf4-23a6-4d81-b216-f44720eb85bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:05:58.852803 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e471cf4-23a6-4d81-b216-f44720eb85bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:05:58.856007 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3e471cf4-23a6-4d81-b216-f44720eb85bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:05:58.861860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:05:58.948873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e471cf4-23a6-4d81-b216-f44720eb85bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:05:58.950713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e471cf4-23a6-4d81-b216-f44720eb85bb service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:05:58.962380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1308/2615] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:06:03.545827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b21ffc-dc30-44f3-b8ce-dd1f43539754 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:03.548062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-31b21ffc-dc30-44f3-b8ce-dd1f43539754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:03.569913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b21ffc-dc30-44f3-b8ce-dd1f43539754 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:03.575792 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:03.576643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:03.576927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:03.577208 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] PATH_INFO: `/v3/users/74f447686a3a41ef8300b20c04c9776a` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:03.578471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f447686a3a41ef8300b20c04c9776a)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:03.580496 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:03.645927 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f447686a3a41ef8300b20c04c9776a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:06:03.660638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f447686a3a41ef8300b20c04c9776a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:06:03.661407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f447686a3a41ef8300b20c04c9776a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:06:03.671130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f447686a3a41ef8300b20c04c9776a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:06:03.671925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5f881a2f-f129-45aa-be53-a7d4873d6735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f447686a3a41ef8300b20c04c9776a'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:06:03.692889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1308/2616] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:06:03 2022] DELETE /identity/v3/users/74f447686a3a41ef8300b20c04c9776a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:06:04.020766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e471cf4-23a6-4d81-b216-f44720eb85bb service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:04.042898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e471cf4-23a6-4d81-b216-f44720eb85bb service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:04.171266 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:04.173149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:04.173624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:04.174132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] PATH_INFO: `/v3/projects/3315d45f6a8746418a65277e2ae89a85` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:04.176407 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3315d45f6a8746418a65277e2ae89a85)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:04.180275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:04.248855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3315d45f6a8746418a65277e2ae89a85', 'request_id': 'req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:06:04.256343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3315d45f6a8746418a65277e2ae89a85', 'request_id': 'req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:06:04.263951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3315d45f6a8746418a65277e2ae89a85', 'request_id': 'req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:06:04.279827 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] The token cache is being invalidate because project 3315d45f6a8746418a65277e2ae89a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:06:04.280108 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:06:04.280809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-712f1a4e-6996-4d2f-82d3-cd54f519b2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:06:04.283267 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1309/2617] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:06:04 2022] DELETE /identity/v3/projects/3315d45f6a8746418a65277e2ae89a85 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:06:04.288685 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a98519-d511-4b1d-b33b-c548e827d386 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:04.288980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a98519-d511-4b1d-b33b-c548e827d386 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:04.289265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a98519-d511-4b1d-b33b-c548e827d386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:04.309822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-20a98519-d511-4b1d-b33b-c548e827d386 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:06:04.311197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-20a98519-d511-4b1d-b33b-c548e827d386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:04.403382 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1309/2618] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:06:04.413133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf0034-b267-41b3-960b-2209b3d52907 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:04.413421 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf0034-b267-41b3-960b-2209b3d52907 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:04.413697 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf0034-b267-41b3-960b-2209b3d52907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:04.436722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3fdf0034-b267-41b3-960b-2209b3d52907 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:06:04.438107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3fdf0034-b267-41b3-960b-2209b3d52907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:04.449374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1310/2619] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:06:04.454838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a98519-d511-4b1d-b33b-c548e827d386 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:04.468742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a98519-d511-4b1d-b33b-c548e827d386 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:04.474620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873c5f3-ae27-4bfb-9667-f7177fb1637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:04.476383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c5f3-ae27-4bfb-9667-f7177fb1637f admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:04.476383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c5f3-ae27-4bfb-9667-f7177fb1637f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:04.476811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c5f3-ae27-4bfb-9667-f7177fb1637f admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:04.477587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873c5f3-ae27-4bfb-9667-f7177fb1637f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:06:04.478084 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873c5f3-ae27-4bfb-9667-f7177fb1637f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:04.480555 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873c5f3-ae27-4bfb-9667-f7177fb1637f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:04.501863 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1310/2620] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:06:04.509491 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf0034-b267-41b3-960b-2209b3d52907 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:04.526164 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf0034-b267-41b3-960b-2209b3d52907 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:04.535154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f5fd6-80dd-4ef5-8f9b-8316d87648f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:04.537527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f5fd6-80dd-4ef5-8f9b-8316d87648f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:04.538672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f5fd6-80dd-4ef5-8f9b-8316d87648f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:04.539779 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f5fd6-80dd-4ef5-8f9b-8316d87648f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:04.541429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f5fd6-80dd-4ef5-8f9b-8316d87648f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:04.545661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f5fd6-80dd-4ef5-8f9b-8316d87648f0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:04.601558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1311/2621] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:06:04 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:06:04.607765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873c5f3-ae27-4bfb-9667-f7177fb1637f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:04.624640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873c5f3-ae27-4bfb-9667-f7177fb1637f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:04.672678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:06:04.730001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affb09d-814a-40ca-be17-94043b7df3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:04.731698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affb09d-814a-40ca-be17-94043b7df3ae admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:04.732204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affb09d-814a-40ca-be17-94043b7df3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:04.732656 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affb09d-814a-40ca-be17-94043b7df3ae admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:04.734293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affb09d-814a-40ca-be17-94043b7df3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:04.738647 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affb09d-814a-40ca-be17-94043b7df3ae admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:04.770414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1311/2622] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:06:04 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:06:04.775107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f5fd6-80dd-4ef5-8f9b-8316d87648f0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:04.781659 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:06:04.789167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f5fd6-80dd-4ef5-8f9b-8316d87648f0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:04.797176 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74594a2-eae7-403c-94a4-095bb5960723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:04.798264 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74594a2-eae7-403c-94a4-095bb5960723 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:04.798787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74594a2-eae7-403c-94a4-095bb5960723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:04.799319 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74594a2-eae7-403c-94a4-095bb5960723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:04.800312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74594a2-eae7-403c-94a4-095bb5960723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:04.802857 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74594a2-eae7-403c-94a4-095bb5960723 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:04.816959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1312/2623] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:06:04.821052 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affb09d-814a-40ca-be17-94043b7df3ae admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:04.840044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affb09d-814a-40ca-be17-94043b7df3ae admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:04.849384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0d7e1-dc3d-43ab-874c-c5c8747064b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:04.850543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0d7e1-dc3d-43ab-874c-c5c8747064b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:04.851053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0d7e1-dc3d-43ab-874c-c5c8747064b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:04.851610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0d7e1-dc3d-43ab-874c-c5c8747064b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:04.853037 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0d7e1-dc3d-43ab-874c-c5c8747064b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:04.856743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0d7e1-dc3d-43ab-874c-c5c8747064b9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:04.872950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1312/2624] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:06:04.878007 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74594a2-eae7-403c-94a4-095bb5960723 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:04.897296 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74594a2-eae7-403c-94a4-095bb5960723 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:04.905988 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429d767-19d2-422f-8ad3-00d1a57586c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:04.907524 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429d767-19d2-422f-8ad3-00d1a57586c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:04.908010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429d767-19d2-422f-8ad3-00d1a57586c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:04.908496 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429d767-19d2-422f-8ad3-00d1a57586c3 admin admin] PATH_INFO: `/v3/projects/5e4ff5de3bbc44ca9f1b5559747b5c93/users/d6ebf747d4a04532aa201a23fb0094f7/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:04.931427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429d767-19d2-422f-8ad3-00d1a57586c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4ff5de3bbc44ca9f1b5559747b5c93, user_id=d6ebf747d4a04532aa201a23fb0094f7, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:04.937257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429d767-19d2-422f-8ad3-00d1a57586c3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:04.962762 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1313/2625] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:06:04 2022] PUT /identity/v3/projects/5e4ff5de3bbc44ca9f1b5559747b5c93/users/d6ebf747d4a04532aa201a23fb0094f7/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:06:04.970388 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64885acd-7571-4100-885e-c50af7309f65 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:04.970902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64885acd-7571-4100-885e-c50af7309f65 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:04.971477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64885acd-7571-4100-885e-c50af7309f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:05.005586 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-64885acd-7571-4100-885e-c50af7309f65 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:06:05.007783 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-64885acd-7571-4100-885e-c50af7309f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:05.152026 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1313/2626] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:06:05.173650 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429d767-19d2-422f-8ad3-00d1a57586c3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:05.177100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8429d767-19d2-422f-8ad3-00d1a57586c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:05.294417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429d767-19d2-422f-8ad3-00d1a57586c3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:05.301588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3660cc-ca7e-4f4f-b15a-0acf73c57b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:05.302959 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3660cc-ca7e-4f4f-b15a-0acf73c57b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:05.303521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3660cc-ca7e-4f4f-b15a-0acf73c57b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:05.304847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3660cc-ca7e-4f4f-b15a-0acf73c57b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:05.321345 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3660cc-ca7e-4f4f-b15a-0acf73c57b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:05.324458 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3660cc-ca7e-4f4f-b15a-0acf73c57b24 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:05.336819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1314/2627] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:06:12.408512 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc72d5-d239-40ae-aee4-8a63ab9851ee None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:12.409169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc72d5-d239-40ae-aee4-8a63ab9851ee None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:12.409883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc72d5-d239-40ae-aee4-8a63ab9851ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:12.478003 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2adc72d5-d239-40ae-aee4-8a63ab9851ee None None] MFA Rules not processed for user `d6ebf747d4a04532aa201a23fb0094f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:06:12.480340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2adc72d5-d239-40ae-aee4-8a63ab9851ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:12.625457 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1314/2628] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:06:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:06:12.642630 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3660cc-ca7e-4f4f-b15a-0acf73c57b24 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:12.644313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fe3660cc-ca7e-4f4f-b15a-0acf73c57b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:12.741297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3660cc-ca7e-4f4f-b15a-0acf73c57b24 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:12.749081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c578b24-4127-4b87-b395-026127a5f4fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:12.750087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c578b24-4127-4b87-b395-026127a5f4fe service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:12.750550 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c578b24-4127-4b87-b395-026127a5f4fe service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:12.751026 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c578b24-4127-4b87-b395-026127a5f4fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:12.761698 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c578b24-4127-4b87-b395-026127a5f4fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:12.763687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c578b24-4127-4b87-b395-026127a5f4fe service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:12.776285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1315/2629] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:06:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:06:14.843707 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb403b66-4d26-4f1e-a38a-1f724bfcb1be None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:14.844339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb403b66-4d26-4f1e-a38a-1f724bfcb1be None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:14.844627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb403b66-4d26-4f1e-a38a-1f724bfcb1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:14.872152 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-cb403b66-4d26-4f1e-a38a-1f724bfcb1be None None] MFA Rules not processed for user `d6ebf747d4a04532aa201a23fb0094f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:06:14.873706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cb403b66-4d26-4f1e-a38a-1f724bfcb1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:14.881940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1315/2630] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:06:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:06:15.505821 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c578b24-4127-4b87-b395-026127a5f4fe service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:15.507482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1c578b24-4127-4b87-b395-026127a5f4fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:15.527105 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c578b24-4127-4b87-b395-026127a5f4fe service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:15.532138 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72cfbe-3449-4597-a5d3-bf9538338d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:15.532817 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72cfbe-3449-4597-a5d3-bf9538338d26 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:15.533184 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72cfbe-3449-4597-a5d3-bf9538338d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:15.533439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72cfbe-3449-4597-a5d3-bf9538338d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:15.536316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6a72cfbe-3449-4597-a5d3-bf9538338d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:15.551117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72cfbe-3449-4597-a5d3-bf9538338d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:15.553894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72cfbe-3449-4597-a5d3-bf9538338d26 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:15.565316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1316/2631] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:06:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:06:16.294464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb403b66-4d26-4f1e-a38a-1f724bfcb1be None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:06:16.295952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-cb403b66-4d26-4f1e-a38a-1f724bfcb1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:16.332041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb403b66-4d26-4f1e-a38a-1f724bfcb1be None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:06:16.343786 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fc1f2-2e7d-4a9c-8263-e560de92646a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:06:16.344885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc1f2-2e7d-4a9c-8263-e560de92646a service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:06:16.345599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc1f2-2e7d-4a9c-8263-e560de92646a service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:06:16.345930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc1f2-2e7d-4a9c-8263-e560de92646a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:06:16.348877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-827fc1f2-2e7d-4a9c-8263-e560de92646a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:06:16.445363 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:06:16.520517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fc1f2-2e7d-4a9c-8263-e560de92646a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:06:16.524584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fc1f2-2e7d-4a9c-8263-e560de92646a service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:06:16.547788 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1316/2632] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:06:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:06:25.561713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:06:26.536504 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=12 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:21.059325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72cfbe-3449-4597-a5d3-bf9538338d26 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:21.060949 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6a72cfbe-3449-4597-a5d3-bf9538338d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:21.169950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72cfbe-3449-4597-a5d3-bf9538338d26 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:21.178251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad5a98-4691-4324-b888-bc9b712ba446 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:21.179476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad5a98-4691-4324-b888-bc9b712ba446 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:21.180045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad5a98-4691-4324-b888-bc9b712ba446 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:21.180663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad5a98-4691-4324-b888-bc9b712ba446 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:21.184022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0fad5a98-4691-4324-b888-bc9b712ba446 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:21.203516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad5a98-4691-4324-b888-bc9b712ba446 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:21.205673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad5a98-4691-4324-b888-bc9b712ba446 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:21.227280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1317/2633] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:07:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:07:27.522266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fc1f2-2e7d-4a9c-8263-e560de92646a service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:27.538802 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fc1f2-2e7d-4a9c-8263-e560de92646a service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:27.544353 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8ae07-f812-48a2-9408-79527e484cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:27.545321 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8ae07-f812-48a2-9408-79527e484cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:27.545745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8ae07-f812-48a2-9408-79527e484cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:27.546150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8ae07-f812-48a2-9408-79527e484cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:27.549395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-b0e8ae07-f812-48a2-9408-79527e484cd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:27.571589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8ae07-f812-48a2-9408-79527e484cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:27.573993 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8ae07-f812-48a2-9408-79527e484cd2 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:27.590898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1317/2634] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:07:31.215974 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=32 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:32.349371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad5a98-4691-4324-b888-bc9b712ba446 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:32.352870 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0fad5a98-4691-4324-b888-bc9b712ba446 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:32.376986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad5a98-4691-4324-b888-bc9b712ba446 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:32.383878 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:32.385227 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:32.385594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:32.385961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] PATH_INFO: `/v3/users/96c9297b1a444ab189d73da643625270` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:32.387806 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c9297b1a444ab189d73da643625270)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:32.389932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:32.453291 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c9297b1a444ab189d73da643625270'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:07:32.475399 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c9297b1a444ab189d73da643625270'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:07:32.485956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c9297b1a444ab189d73da643625270'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:07:32.486656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c9297b1a444ab189d73da643625270'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:07:32.496112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ce175f4-0fb9-4464-b445-78f9a2247428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c9297b1a444ab189d73da643625270'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:07:32.502760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1318/2635] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:07:32 2022] DELETE /identity/v3/users/96c9297b1a444ab189d73da643625270 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:07:32.729215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8ae07-f812-48a2-9408-79527e484cd2 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:32.744265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8ae07-f812-48a2-9408-79527e484cd2 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:32.832402 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:32.833374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:32.833728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:32.834053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] PATH_INFO: `/v3/projects/c0b220cc96e747b39c0cfaffe5446bfd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:32.836133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b220cc96e747b39c0cfaffe5446bfd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:32.839092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:32.902942 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b220cc96e747b39c0cfaffe5446bfd', 'request_id': 'req-7325c749-269c-4220-90a0-a863f2ed09c4'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:07:32.910464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b220cc96e747b39c0cfaffe5446bfd', 'request_id': 'req-7325c749-269c-4220-90a0-a863f2ed09c4'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:07:32.922356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b220cc96e747b39c0cfaffe5446bfd', 'request_id': 'req-7325c749-269c-4220-90a0-a863f2ed09c4'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:07:32.939196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] The token cache is being invalidate because project c0b220cc96e747b39c0cfaffe5446bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:07:32.939704 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:07:32.940880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7325c749-269c-4220-90a0-a863f2ed09c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:07:32.942828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1318/2636] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:07:32 2022] DELETE /identity/v3/projects/c0b220cc96e747b39c0cfaffe5446bfd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:07:32.948697 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074e644-2ed9-4a95-9e3c-e8734b7382ae None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:32.948992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074e644-2ed9-4a95-9e3c-e8734b7382ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:32.949285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074e644-2ed9-4a95-9e3c-e8734b7382ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:32.970239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3074e644-2ed9-4a95-9e3c-e8734b7382ae None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:07:32.972341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3074e644-2ed9-4a95-9e3c-e8734b7382ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:33.063334 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1319/2637] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:07:33.074508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360c4a9-29ee-4b71-aca1-8a5d356aaca7 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:33.074810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360c4a9-29ee-4b71-aca1-8a5d356aaca7 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:33.075073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360c4a9-29ee-4b71-aca1-8a5d356aaca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:33.105744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a360c4a9-29ee-4b71-aca1-8a5d356aaca7 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:07:33.107031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a360c4a9-29ee-4b71-aca1-8a5d356aaca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:33.116215 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1319/2638] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:07:33.121614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074e644-2ed9-4a95-9e3c-e8734b7382ae None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:33.137809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074e644-2ed9-4a95-9e3c-e8734b7382ae None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:33.151194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ee2fe-825e-4c64-8b37-46bc61be29a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:33.152721 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ee2fe-825e-4c64-8b37-46bc61be29a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:33.153302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ee2fe-825e-4c64-8b37-46bc61be29a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:33.153719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ee2fe-825e-4c64-8b37-46bc61be29a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:33.156397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ee2fe-825e-4c64-8b37-46bc61be29a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:07:33.156397 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ee2fe-825e-4c64-8b37-46bc61be29a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:33.159592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ee2fe-825e-4c64-8b37-46bc61be29a4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:33.185090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1320/2639] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:07:33.190230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360c4a9-29ee-4b71-aca1-8a5d356aaca7 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:33.207196 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360c4a9-29ee-4b71-aca1-8a5d356aaca7 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:33.216378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f0d4-ab7a-4a3b-a70a-9bb6b2e53104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:33.217824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f0d4-ab7a-4a3b-a70a-9bb6b2e53104 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:33.218388 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f0d4-ab7a-4a3b-a70a-9bb6b2e53104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:33.218926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f0d4-ab7a-4a3b-a70a-9bb6b2e53104 admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:33.220259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247f0d4-ab7a-4a3b-a70a-9bb6b2e53104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:33.224226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247f0d4-ab7a-4a3b-a70a-9bb6b2e53104 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:33.283206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1320/2640] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:07:33 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:07:33.286852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ee2fe-825e-4c64-8b37-46bc61be29a4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:33.299873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ee2fe-825e-4c64-8b37-46bc61be29a4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:33.371479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39e741-a9a8-4725-847c-1d7fe4a57783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:33.372559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39e741-a9a8-4725-847c-1d7fe4a57783 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:33.372559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39e741-a9a8-4725-847c-1d7fe4a57783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:33.372875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39e741-a9a8-4725-847c-1d7fe4a57783 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:33.373444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39e741-a9a8-4725-847c-1d7fe4a57783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:33.375449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39e741-a9a8-4725-847c-1d7fe4a57783 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:33.384412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:33.403900 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1321/2641] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:07:33 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:07:33.408226 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f0d4-ab7a-4a3b-a70a-9bb6b2e53104 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:33.420132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f0d4-ab7a-4a3b-a70a-9bb6b2e53104 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:33.425129 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276e921-d58d-4db6-b685-1a0f17859b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:33.425810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e921-d58d-4db6-b685-1a0f17859b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:33.426127 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e921-d58d-4db6-b685-1a0f17859b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:33.426403 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e921-d58d-4db6-b685-1a0f17859b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:33.427145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276e921-d58d-4db6-b685-1a0f17859b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:33.428875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276e921-d58d-4db6-b685-1a0f17859b0d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:33.443320 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1321/2642] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:07:33.449435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39e741-a9a8-4725-847c-1d7fe4a57783 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:33.468104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39e741-a9a8-4725-847c-1d7fe4a57783 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:33.473956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae712ae-fd26-4d97-9add-67c0b6b04c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:33.474740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae712ae-fd26-4d97-9add-67c0b6b04c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:33.475139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae712ae-fd26-4d97-9add-67c0b6b04c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:33.475514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae712ae-fd26-4d97-9add-67c0b6b04c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:33.477257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae712ae-fd26-4d97-9add-67c0b6b04c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:33.479832 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae712ae-fd26-4d97-9add-67c0b6b04c72 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:33.501003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1322/2643] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:07:33.507456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276e921-d58d-4db6-b685-1a0f17859b0d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:33.520451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276e921-d58d-4db6-b685-1a0f17859b0d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:33.525826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913539f-548d-46f4-af51-954d409d2957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:33.526784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913539f-548d-46f4-af51-954d409d2957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:33.527021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913539f-548d-46f4-af51-954d409d2957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:33.527407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913539f-548d-46f4-af51-954d409d2957 admin admin] PATH_INFO: `/v3/projects/e4d17007034a460f954581363807ee8f/users/a2d7dd932d1c49a39345268d28406222/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:33.545279 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913539f-548d-46f4-af51-954d409d2957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d17007034a460f954581363807ee8f, user_id=a2d7dd932d1c49a39345268d28406222, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:33.548092 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913539f-548d-46f4-af51-954d409d2957 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:33.566816 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1322/2644] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:07:33 2022] PUT /identity/v3/projects/e4d17007034a460f954581363807ee8f/users/a2d7dd932d1c49a39345268d28406222/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:07:33.588004 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565aa50-be57-44f1-9d68-53e0e9709989 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:33.588452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565aa50-be57-44f1-9d68-53e0e9709989 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:33.589068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565aa50-be57-44f1-9d68-53e0e9709989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:33.625045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a565aa50-be57-44f1-9d68-53e0e9709989 None None] MFA Rules not processed for user `a2d7dd932d1c49a39345268d28406222`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:07:33.626521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a565aa50-be57-44f1-9d68-53e0e9709989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:33.754666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1323/2645] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:07:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:07:33.760065 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913539f-548d-46f4-af51-954d409d2957 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:33.777356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:33.846476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913539f-548d-46f4-af51-954d409d2957 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:33.854883 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032877-52a2-4f1a-94ca-81ee5539296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:33.856100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032877-52a2-4f1a-94ca-81ee5539296e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:33.856610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032877-52a2-4f1a-94ca-81ee5539296e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:33.857117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032877-52a2-4f1a-94ca-81ee5539296e admin admin] PATH_INFO: `/v3/projects` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:33.858439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0032877-52a2-4f1a-94ca-81ee5539296e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:33.862303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0032877-52a2-4f1a-94ca-81ee5539296e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:33.906087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1323/2646] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:07:33 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:07:33.910720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565aa50-be57-44f1-9d68-53e0e9709989 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:33.924834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565aa50-be57-44f1-9d68-53e0e9709989 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:34.013851 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b172-8a04-4931-b18b-172df8479b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:34.014844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b172-8a04-4931-b18b-172df8479b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:34.015384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b172-8a04-4931-b18b-172df8479b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:34.015881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b172-8a04-4931-b18b-172df8479b07 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:34.017179 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586b172-8a04-4931-b18b-172df8479b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:34.020986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586b172-8a04-4931-b18b-172df8479b07 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:34.051025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1324/2647] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:07:33 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:07:34.056840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032877-52a2-4f1a-94ca-81ee5539296e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:34.068937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032877-52a2-4f1a-94ca-81ee5539296e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:34.075729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edf633-e38d-4aab-a75c-8a21c7c6f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:34.076866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edf633-e38d-4aab-a75c-8a21c7c6f485 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:34.077352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edf633-e38d-4aab-a75c-8a21c7c6f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:34.077874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edf633-e38d-4aab-a75c-8a21c7c6f485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:34.079256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edf633-e38d-4aab-a75c-8a21c7c6f485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:34.082438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edf633-e38d-4aab-a75c-8a21c7c6f485 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:34.097624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1324/2648] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:07:34.103074 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b172-8a04-4931-b18b-172df8479b07 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:34.120298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b172-8a04-4931-b18b-172df8479b07 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:34.128462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05933c48-1e4a-41a1-af61-3c21b61180e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:34.130007 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05933c48-1e4a-41a1-af61-3c21b61180e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:34.130492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05933c48-1e4a-41a1-af61-3c21b61180e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:34.130985 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05933c48-1e4a-41a1-af61-3c21b61180e9 admin admin] PATH_INFO: `/v3/projects/78e541b9bdee4e42a1e9238652126d79/users/4636ff38c69c4b1badf4f2e600005230/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:34.160534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05933c48-1e4a-41a1-af61-3c21b61180e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e541b9bdee4e42a1e9238652126d79, user_id=4636ff38c69c4b1badf4f2e600005230, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:34.166113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05933c48-1e4a-41a1-af61-3c21b61180e9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:34.189703 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1325/2649] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:07:34 2022] PUT /identity/v3/projects/78e541b9bdee4e42a1e9238652126d79/users/4636ff38c69c4b1badf4f2e600005230/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:07:34.194110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edf633-e38d-4aab-a75c-8a21c7c6f485 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:34.207007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edf633-e38d-4aab-a75c-8a21c7c6f485 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:34.276907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53efcf-b1af-45e1-8bbc-41140ad2db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:34.277522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53efcf-b1af-45e1-8bbc-41140ad2db13 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:34.277810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53efcf-b1af-45e1-8bbc-41140ad2db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:34.278089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53efcf-b1af-45e1-8bbc-41140ad2db13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:34.278849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53efcf-b1af-45e1-8bbc-41140ad2db13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:34.280937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53efcf-b1af-45e1-8bbc-41140ad2db13 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:34.294361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1325/2650] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:07:34.298751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05933c48-1e4a-41a1-af61-3c21b61180e9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:34.312127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05933c48-1e4a-41a1-af61-3c21b61180e9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:34.317744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d868f6-670c-465b-964c-a5ad1b663923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:34.318945 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d868f6-670c-465b-964c-a5ad1b663923 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:34.319340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d868f6-670c-465b-964c-a5ad1b663923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:34.319724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d868f6-670c-465b-964c-a5ad1b663923 admin admin] PATH_INFO: `/v3/projects/78e541b9bdee4e42a1e9238652126d79/users/4636ff38c69c4b1badf4f2e600005230/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:34.323043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d868f6-670c-465b-964c-a5ad1b663923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e541b9bdee4e42a1e9238652126d79, user_id=4636ff38c69c4b1badf4f2e600005230, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:34.325972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d868f6-670c-465b-964c-a5ad1b663923 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:34.344742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1326/2651] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:07:34 2022] PUT /identity/v3/projects/78e541b9bdee4e42a1e9238652126d79/users/4636ff38c69c4b1badf4f2e600005230/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:07:34.358051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc657d7-f089-4e13-a9f2-ec7a048548e9 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:34.358613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc657d7-f089-4e13-a9f2-ec7a048548e9 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:34.359137 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc657d7-f089-4e13-a9f2-ec7a048548e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:34.406033 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4fc657d7-f089-4e13-a9f2-ec7a048548e9 None None] MFA Rules not processed for user `4636ff38c69c4b1badf4f2e600005230`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:07:34.407299 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4fc657d7-f089-4e13-a9f2-ec7a048548e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:34.525020 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1326/2652] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:07:34.537259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d868f6-670c-465b-964c-a5ad1b663923 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:34.542230 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9d868f6-670c-465b-964c-a5ad1b663923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:34.584654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:34.654933 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d868f6-670c-465b-964c-a5ad1b663923 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:34.661284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238b069-6a20-4969-9fde-b13a16ab666d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:34.662251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238b069-6a20-4969-9fde-b13a16ab666d service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:34.662661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238b069-6a20-4969-9fde-b13a16ab666d service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:34.663120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238b069-6a20-4969-9fde-b13a16ab666d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:34.682749 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238b069-6a20-4969-9fde-b13a16ab666d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:34.685536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238b069-6a20-4969-9fde-b13a16ab666d service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:34.704285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1327/2653] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:07:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:07:34.795654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc657d7-f089-4e13-a9f2-ec7a048548e9 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:34.809559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc657d7-f089-4e13-a9f2-ec7a048548e9 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:34.814433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80311bfe-7ea5-41c1-a59f-dbc77f76aa4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:34.815197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311bfe-7ea5-41c1-a59f-dbc77f76aa4f service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:34.819137 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311bfe-7ea5-41c1-a59f-dbc77f76aa4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:34.819471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311bfe-7ea5-41c1-a59f-dbc77f76aa4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:34.826543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:34.891837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80311bfe-7ea5-41c1-a59f-dbc77f76aa4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:34.893658 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80311bfe-7ea5-41c1-a59f-dbc77f76aa4f service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:34.906057 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1327/2654] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:07:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:07:37.270597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba44f45-816c-43c0-ba6e-f2f24a3c4c29 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:37.271513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba44f45-816c-43c0-ba6e-f2f24a3c4c29 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:37.272035 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba44f45-816c-43c0-ba6e-f2f24a3c4c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:37.302055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6ba44f45-816c-43c0-ba6e-f2f24a3c4c29 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:07:37.306273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6ba44f45-816c-43c0-ba6e-f2f24a3c4c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:37.440045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1328/2655] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:07:37.518329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80311bfe-7ea5-41c1-a59f-dbc77f76aa4f service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:37.524365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-80311bfe-7ea5-41c1-a59f-dbc77f76aa4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:37.640620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80311bfe-7ea5-41c1-a59f-dbc77f76aa4f service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:37.649297 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2d71c-f157-444f-9dff-271895dffc1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:37.650328 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2d71c-f157-444f-9dff-271895dffc1f service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:37.650682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2d71c-f157-444f-9dff-271895dffc1f service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:37.651030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2d71c-f157-444f-9dff-271895dffc1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:37.662291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2d71c-f157-444f-9dff-271895dffc1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:37.665510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2d71c-f157-444f-9dff-271895dffc1f service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:37.676177 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1328/2656] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:07:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:07:47.420582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=42 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:47.671745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=56 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:07:53.063603 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ea30-9929-4d2a-b8c4-27415724e938 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:53.064610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ea30-9929-4d2a-b8c4-27415724e938 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:53.064610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ea30-9929-4d2a-b8c4-27415724e938 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:53.065640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1329/2657] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 16:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:07:53.073634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f24ae-cc68-4b5c-80eb-929ab906dc36 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:53.074532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f24ae-cc68-4b5c-80eb-929ab906dc36 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:53.074532 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f24ae-cc68-4b5c-80eb-929ab906dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:53.120156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bd8f24ae-cc68-4b5c-80eb-929ab906dc36 None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:07:53.121459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bd8f24ae-cc68-4b5c-80eb-929ab906dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:53.223289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1329/2658] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 16:07:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:07:53.238141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47ea30-9929-4d2a-b8c4-27415724e938 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:53.241479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ca47ea30-9929-4d2a-b8c4-27415724e938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:53.353770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47ea30-9929-4d2a-b8c4-27415724e938 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:53.359697 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d89d10-7696-4497-83d0-c3f7ae846e9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61565364dbac41cfac76195c0be88771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:53.360777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d89d10-7696-4497-83d0-c3f7ae846e9f service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:53.361297 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d89d10-7696-4497-83d0-c3f7ae846e9f service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:53.361777 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d89d10-7696-4497-83d0-c3f7ae846e9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:53.383956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d89d10-7696-4497-83d0-c3f7ae846e9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:53.388552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d89d10-7696-4497-83d0-c3f7ae846e9f service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:53.415342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1330/2659] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:07:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:07:53.520072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33f1b-59d7-4f6e-b06c-12c58e0705be None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:53.520411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33f1b-59d7-4f6e-b06c-12c58e0705be None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:53.520796 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33f1b-59d7-4f6e-b06c-12c58e0705be None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:53.522368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1330/2660] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 16:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:07:53.528937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee0fcb-6b59-45a0-ac74-c0f628a32d77 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:53.529292 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee0fcb-6b59-45a0-ac74-c0f628a32d77 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:53.529629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee0fcb-6b59-45a0-ac74-c0f628a32d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:53.551356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4cee0fcb-6b59-45a0-ac74-c0f628a32d77 None None] MFA Rules not processed for user `2d3018419d0548eda04b3539681f3df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:07:53.552661 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4cee0fcb-6b59-45a0-ac74-c0f628a32d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:53.614845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1331/2661] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 16:07:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:07:53.631115 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33f1b-59d7-4f6e-b06c-12c58e0705be None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:53.634369 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c1f33f1b-59d7-4f6e-b06c-12c58e0705be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:53.651053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33f1b-59d7-4f6e-b06c-12c58e0705be None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:53.655463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505f1d-9604-4a61-a1ce-bbed8d792980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:53.656151 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505f1d-9604-4a61-a1ce-bbed8d792980 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:53.656441 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505f1d-9604-4a61-a1ce-bbed8d792980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:53.656725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505f1d-9604-4a61-a1ce-bbed8d792980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:53.667072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505f1d-9604-4a61-a1ce-bbed8d792980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:53.668858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505f1d-9604-4a61-a1ce-bbed8d792980 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:53.678846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1331/2662] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:07:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:07:53.784033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaa7eb-6bc3-41a9-a20a-ead71b5294a2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:53.784480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaa7eb-6bc3-41a9-a20a-ead71b5294a2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:53.784876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaa7eb-6bc3-41a9-a20a-ead71b5294a2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:53.786583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1332/2663] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 16:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 16:07:53.795409 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415009-4320-4f01-b1c7-989ebb271ca5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:53.795703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415009-4320-4f01-b1c7-989ebb271ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:53.795985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415009-4320-4f01-b1c7-989ebb271ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:53.822297 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-07415009-4320-4f01-b1c7-989ebb271ca5 None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:07:53.824765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-07415009-4320-4f01-b1c7-989ebb271ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:53.842948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1332/2664] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 16:07:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:07:53.857466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaa7eb-6bc3-41a9-a20a-ead71b5294a2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:53.871354 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaa7eb-6bc3-41a9-a20a-ead71b5294a2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:53.875310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa075fe-5dbe-438c-9bf6-be1b3eaea1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:53.876002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa075fe-5dbe-438c-9bf6-be1b3eaea1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:53.876447 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa075fe-5dbe-438c-9bf6-be1b3eaea1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:53.876729 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa075fe-5dbe-438c-9bf6-be1b3eaea1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:53.888930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa075fe-5dbe-438c-9bf6-be1b3eaea1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:53.890405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa075fe-5dbe-438c-9bf6-be1b3eaea1f5 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:53.904400 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1333/2665] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:07:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:07:56.800717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407c33-6976-4f01-a91e-28a01dd4bd4e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:56.801424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407c33-6976-4f01-a91e-28a01dd4bd4e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:56.801424 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8407c33-6976-4f01-a91e-28a01dd4bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:56.826531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-e8407c33-6976-4f01-a91e-28a01dd4bd4e None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:07:56.828054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e8407c33-6976-4f01-a91e-28a01dd4bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:07:56.836744 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1333/2666] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 16:07:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:07:56.854600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa075fe-5dbe-438c-9bf6-be1b3eaea1f5 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:07:56.881020 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa075fe-5dbe-438c-9bf6-be1b3eaea1f5 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:07:56.888810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd9cec-b959-42a0-a7cc-128d7bed54d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:07:56.889955 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd9cec-b959-42a0-a7cc-128d7bed54d0 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:07:56.890736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd9cec-b959-42a0-a7cc-128d7bed54d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:07:56.891525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd9cec-b959-42a0-a7cc-128d7bed54d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:07:56.910426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd9cec-b959-42a0-a7cc-128d7bed54d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:07:56.912887 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd9cec-b959-42a0-a7cc-128d7bed54d0 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:07:56.932206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1334/2667] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:07:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 16:08:06.818276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=49 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:06.921965 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=61 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:08.681138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8407c33-6976-4f01-a91e-28a01dd4bd4e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:08.769575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8407c33-6976-4f01-a91e-28a01dd4bd4e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:08.780836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:08.782732 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:08.783447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:08.784108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] PATH_INFO: `/v3/users/a2d7dd932d1c49a39345268d28406222` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:08.786479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d7dd932d1c49a39345268d28406222)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:08.790998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:08.856046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d7dd932d1c49a39345268d28406222'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:08.874230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d7dd932d1c49a39345268d28406222'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:08.875008 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d7dd932d1c49a39345268d28406222'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:08.884522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d7dd932d1c49a39345268d28406222'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:08.885281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d7dd932d1c49a39345268d28406222'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:08.904044 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1334/2668] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:08:08 2022] DELETE /identity/v3/users/a2d7dd932d1c49a39345268d28406222 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:08.905789 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45800-5483-4008-a199-10c99af6eaac None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:08.906335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45800-5483-4008-a199-10c99af6eaac None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:08.906335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa45800-5483-4008-a199-10c99af6eaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:08.941501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5aa45800-5483-4008-a199-10c99af6eaac None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:08.944679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5aa45800-5483-4008-a199-10c99af6eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:09.025435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1335/2669] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:09.039142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:09.041195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:09.111760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012397b0-15f8-4114-8cdb-24bcfe986ea0 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:09.115643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901deac0-13ce-4a81-b9cf-7d3845bbc573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:09.117683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901deac0-13ce-4a81-b9cf-7d3845bbc573 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:09.117979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901deac0-13ce-4a81-b9cf-7d3845bbc573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:09.118305 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901deac0-13ce-4a81-b9cf-7d3845bbc573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:09.129417 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901deac0-13ce-4a81-b9cf-7d3845bbc573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:09.131098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901deac0-13ce-4a81-b9cf-7d3845bbc573 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:09.143752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1335/2670] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:08:10.046921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa45800-5483-4008-a199-10c99af6eaac None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:10.052808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5aa45800-5483-4008-a199-10c99af6eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:10.076047 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa45800-5483-4008-a199-10c99af6eaac None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:10.091869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:10.093060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:10.093486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:10.094028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] PATH_INFO: `/v3/projects/e4d17007034a460f954581363807ee8f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:10.096413 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d17007034a460f954581363807ee8f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:10.098969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:10.178204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d17007034a460f954581363807ee8f', 'request_id': 'req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:10.189564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d17007034a460f954581363807ee8f', 'request_id': 'req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:10.199525 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d17007034a460f954581363807ee8f', 'request_id': 'req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:10.220194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] The token cache is being invalidate because project e4d17007034a460f954581363807ee8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:08:10.220664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:10.221536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:10.223635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1336/2671] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:08:10 2022] DELETE /identity/v3/projects/e4d17007034a460f954581363807ee8f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:10.229682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901deac0-13ce-4a81-b9cf-7d3845bbc573 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:10.247735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901deac0-13ce-4a81-b9cf-7d3845bbc573 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:10.280252 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:10.358614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:10.359470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:10.359757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:10.360045 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] PATH_INFO: `/v3/users/4636ff38c69c4b1badf4f2e600005230` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:10.361450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4636ff38c69c4b1badf4f2e600005230)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:10.363534 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:10.430342 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4636ff38c69c4b1badf4f2e600005230'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:10.446064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4636ff38c69c4b1badf4f2e600005230'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:10.446823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4636ff38c69c4b1badf4f2e600005230'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:10.455422 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4636ff38c69c4b1badf4f2e600005230'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:10.456299 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-06135b1e-a686-4f93-bb7b-2e6d8a42dbd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4636ff38c69c4b1badf4f2e600005230'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:10.472590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1336/2672] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:08:10 2022] DELETE /identity/v3/users/4636ff38c69c4b1badf4f2e600005230 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:10.846256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:10.848173 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:10.882898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b18cf-ae9c-4f15-9ef0-66deb3caba09 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:10.972206 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:10.973150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:10.973485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:10.973804 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] PATH_INFO: `/v3/projects/78e541b9bdee4e42a1e9238652126d79` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:10.975896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e541b9bdee4e42a1e9238652126d79)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:10.978107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:11.015667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:11.043118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e541b9bdee4e42a1e9238652126d79', 'request_id': 'req-a41a9849-2d3b-4c86-87ad-0ae9a8060271'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:11.051666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e541b9bdee4e42a1e9238652126d79', 'request_id': 'req-a41a9849-2d3b-4c86-87ad-0ae9a8060271'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:11.062763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e541b9bdee4e42a1e9238652126d79', 'request_id': 'req-a41a9849-2d3b-4c86-87ad-0ae9a8060271'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:11.081006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] The token cache is being invalidate because project 78e541b9bdee4e42a1e9238652126d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:08:11.081384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:11.082122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a41a9849-2d3b-4c86-87ad-0ae9a8060271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:11.083886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1337/2673] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:08:10 2022] DELETE /identity/v3/projects/78e541b9bdee4e42a1e9238652126d79 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:11.091632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c60e39-abe7-4c5a-b8e7-a8341adc0d75 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:11.092109 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c60e39-abe7-4c5a-b8e7-a8341adc0d75 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:11.092486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c60e39-abe7-4c5a-b8e7-a8341adc0d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:11.114193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-f1c60e39-abe7-4c5a-b8e7-a8341adc0d75 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:11.115622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-f1c60e39-abe7-4c5a-b8e7-a8341adc0d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:11.201799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1337/2674] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:11.211531 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ccebf-6293-4843-8955-426b9dd4383a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:11.211860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ccebf-6293-4843-8955-426b9dd4383a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:11.212177 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ccebf-6293-4843-8955-426b9dd4383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:11.239113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5f1ccebf-6293-4843-8955-426b9dd4383a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:11.242205 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5f1ccebf-6293-4843-8955-426b9dd4383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:11.251935 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1338/2675] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:08:11.259031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c60e39-abe7-4c5a-b8e7-a8341adc0d75 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:11.271048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c60e39-abe7-4c5a-b8e7-a8341adc0d75 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:11.277767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a681ed9-2939-49a2-8690-7855a41b63ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:11.278627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a681ed9-2939-49a2-8690-7855a41b63ba admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:11.279113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a681ed9-2939-49a2-8690-7855a41b63ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:11.279653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a681ed9-2939-49a2-8690-7855a41b63ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:11.281051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a681ed9-2939-49a2-8690-7855a41b63ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:08:11.281605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a681ed9-2939-49a2-8690-7855a41b63ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:11.284784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a681ed9-2939-49a2-8690-7855a41b63ba admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:11.309699 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1338/2676] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:08:11.314243 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ccebf-6293-4843-8955-426b9dd4383a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:11.331962 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ccebf-6293-4843-8955-426b9dd4383a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:11.342037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aeeed-39db-49e8-bf39-37ba588f5e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:11.343223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aeeed-39db-49e8-bf39-37ba588f5e96 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:11.343810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aeeed-39db-49e8-bf39-37ba588f5e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:11.344094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aeeed-39db-49e8-bf39-37ba588f5e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:11.344872 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aeeed-39db-49e8-bf39-37ba588f5e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:11.347245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aeeed-39db-49e8-bf39-37ba588f5e96 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:11.380581 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1339/2677] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:08:11 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:11.387125 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a681ed9-2939-49a2-8690-7855a41b63ba admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:11.399442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a681ed9-2939-49a2-8690-7855a41b63ba admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:11.430078 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:11.479191 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f10e1-7c91-458c-bb3e-55f69bced9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:11.480558 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f10e1-7c91-458c-bb3e-55f69bced9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:11.481054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f10e1-7c91-458c-bb3e-55f69bced9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:11.481703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f10e1-7c91-458c-bb3e-55f69bced9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:11.483274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f10e1-7c91-458c-bb3e-55f69bced9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:11.486868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f10e1-7c91-458c-bb3e-55f69bced9a6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:11.514472 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1339/2678] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:08:11 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:11.522830 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aeeed-39db-49e8-bf39-37ba588f5e96 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:11.543197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aeeed-39db-49e8-bf39-37ba588f5e96 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:11.552098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64a5ad-ca4b-4caa-8a0a-413aed2098ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:11.553303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64a5ad-ca4b-4caa-8a0a-413aed2098ff admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:11.553951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64a5ad-ca4b-4caa-8a0a-413aed2098ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:11.554288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64a5ad-ca4b-4caa-8a0a-413aed2098ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:11.555773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64a5ad-ca4b-4caa-8a0a-413aed2098ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:11.559269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64a5ad-ca4b-4caa-8a0a-413aed2098ff admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:11.579460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1340/2679] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:08:11.586180 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f10e1-7c91-458c-bb3e-55f69bced9a6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:11.607506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f10e1-7c91-458c-bb3e-55f69bced9a6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:11.617311 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db38607-383e-4b7c-8e21-44e80a620f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:11.619361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38607-383e-4b7c-8e21-44e80a620f0d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:11.623016 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38607-383e-4b7c-8e21-44e80a620f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:11.624710 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38607-383e-4b7c-8e21-44e80a620f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:11.625822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db38607-383e-4b7c-8e21-44e80a620f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:11.629214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db38607-383e-4b7c-8e21-44e80a620f0d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:11.663884 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1340/2680] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:08:11.665633 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64a5ad-ca4b-4caa-8a0a-413aed2098ff admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:11.680015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64a5ad-ca4b-4caa-8a0a-413aed2098ff admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:11.686328 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cd399-eea2-4fd7-b87d-5a8d7b11d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:11.687660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cd399-eea2-4fd7-b87d-5a8d7b11d912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:11.688242 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cd399-eea2-4fd7-b87d-5a8d7b11d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:11.688629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cd399-eea2-4fd7-b87d-5a8d7b11d912 admin admin] PATH_INFO: `/v3/projects/6929ef48529e47beb464b860dda309c7/users/672a1c3513884640a75594e24d04e0b2/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:11.717093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cd399-eea2-4fd7-b87d-5a8d7b11d912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6929ef48529e47beb464b860dda309c7, user_id=672a1c3513884640a75594e24d04e0b2, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:11.721536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cd399-eea2-4fd7-b87d-5a8d7b11d912 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:11.748910 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1341/2681] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:08:11 2022] PUT /identity/v3/projects/6929ef48529e47beb464b860dda309c7/users/672a1c3513884640a75594e24d04e0b2/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:08:11.768316 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a47a6-ec65-4463-b277-98b0cec6ddb5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:11.768824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a47a6-ec65-4463-b277-98b0cec6ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:11.769329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a47a6-ec65-4463-b277-98b0cec6ddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:11.818576 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ad8a47a6-ec65-4463-b277-98b0cec6ddb5 None None] MFA Rules not processed for user `672a1c3513884640a75594e24d04e0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:11.822029 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ad8a47a6-ec65-4463-b277-98b0cec6ddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:11.920313 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1341/2682] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:11.927288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cd399-eea2-4fd7-b87d-5a8d7b11d912 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:12.029002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cd399-eea2-4fd7-b87d-5a8d7b11d912 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:12.035465 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45874a-6937-4b97-b12a-e56ec3cfd483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:12.036253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45874a-6937-4b97-b12a-e56ec3cfd483 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:12.036604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45874a-6937-4b97-b12a-e56ec3cfd483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:12.036942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45874a-6937-4b97-b12a-e56ec3cfd483 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:12.037735 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45874a-6937-4b97-b12a-e56ec3cfd483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:12.041797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45874a-6937-4b97-b12a-e56ec3cfd483 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:12.076737 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1342/2683] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:08:11 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:12.081679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a47a6-ec65-4463-b277-98b0cec6ddb5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:12.096821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a47a6-ec65-4463-b277-98b0cec6ddb5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:12.191547 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a056ae-3387-4699-b876-03fcc71646f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:12.192719 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a056ae-3387-4699-b876-03fcc71646f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:12.193378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a056ae-3387-4699-b876-03fcc71646f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:12.194522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a056ae-3387-4699-b876-03fcc71646f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:12.196609 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a056ae-3387-4699-b876-03fcc71646f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:12.200407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a056ae-3387-4699-b876-03fcc71646f9 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:12.237286 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1342/2684] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:08:12 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:08:12.242856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45874a-6937-4b97-b12a-e56ec3cfd483 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:12.256303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45874a-6937-4b97-b12a-e56ec3cfd483 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:12.263112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984af2a-4322-4c70-8caf-74c9b679fae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:12.263943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984af2a-4322-4c70-8caf-74c9b679fae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:12.264277 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984af2a-4322-4c70-8caf-74c9b679fae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:12.264695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984af2a-4322-4c70-8caf-74c9b679fae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:12.265516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984af2a-4322-4c70-8caf-74c9b679fae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:12.267262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984af2a-4322-4c70-8caf-74c9b679fae9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:12.288486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1343/2685] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:08:12.294663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a056ae-3387-4699-b876-03fcc71646f9 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:12.311595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a056ae-3387-4699-b876-03fcc71646f9 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:12.318163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea62009-8944-4c65-96c4-6ab7e0d5b247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:12.320497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62009-8944-4c65-96c4-6ab7e0d5b247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:12.320886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62009-8944-4c65-96c4-6ab7e0d5b247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:12.321275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62009-8944-4c65-96c4-6ab7e0d5b247 admin admin] PATH_INFO: `/v3/projects/981beb4475e9473db953a7dfc768cce8/users/3fbd65dbc0184db2bd520991e5529fe5/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:12.349446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea62009-8944-4c65-96c4-6ab7e0d5b247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981beb4475e9473db953a7dfc768cce8, user_id=3fbd65dbc0184db2bd520991e5529fe5, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:12.355075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea62009-8944-4c65-96c4-6ab7e0d5b247 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:12.385453 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1343/2686] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:08:12 2022] PUT /identity/v3/projects/981beb4475e9473db953a7dfc768cce8/users/3fbd65dbc0184db2bd520991e5529fe5/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:08:12.392521 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984af2a-4322-4c70-8caf-74c9b679fae9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:12.419002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984af2a-4322-4c70-8caf-74c9b679fae9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:12.473968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:12.552551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e28d2-8beb-4357-816b-409ebf3f508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:12.555373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e28d2-8beb-4357-816b-409ebf3f508e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:12.556228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e28d2-8beb-4357-816b-409ebf3f508e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:12.557438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e28d2-8beb-4357-816b-409ebf3f508e admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:12.558516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e28d2-8beb-4357-816b-409ebf3f508e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:12.560488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e28d2-8beb-4357-816b-409ebf3f508e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:12.578051 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1344/2687] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:08:12.581483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea62009-8944-4c65-96c4-6ab7e0d5b247 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:12.595863 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:12.608672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea62009-8944-4c65-96c4-6ab7e0d5b247 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:12.617901 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c796f3-9cb9-4307-b6dd-d0db2f35f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:12.619611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c796f3-9cb9-4307-b6dd-d0db2f35f236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:12.620116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c796f3-9cb9-4307-b6dd-d0db2f35f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:12.620629 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c796f3-9cb9-4307-b6dd-d0db2f35f236 admin admin] PATH_INFO: `/v3/projects/981beb4475e9473db953a7dfc768cce8/users/3fbd65dbc0184db2bd520991e5529fe5/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:12.624520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c796f3-9cb9-4307-b6dd-d0db2f35f236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981beb4475e9473db953a7dfc768cce8, user_id=3fbd65dbc0184db2bd520991e5529fe5, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:12.630169 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c796f3-9cb9-4307-b6dd-d0db2f35f236 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:12.652383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1344/2688] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:08:12 2022] PUT /identity/v3/projects/981beb4475e9473db953a7dfc768cce8/users/3fbd65dbc0184db2bd520991e5529fe5/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:12.665180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f5405-4c89-4b1e-879a-fd9238cd19a1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:12.665529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f5405-4c89-4b1e-879a-fd9238cd19a1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:12.665848 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f5405-4c89-4b1e-879a-fd9238cd19a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:12.698051 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9d8f5405-4c89-4b1e-879a-fd9238cd19a1 None None] MFA Rules not processed for user `3fbd65dbc0184db2bd520991e5529fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:12.699358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9d8f5405-4c89-4b1e-879a-fd9238cd19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:12.790251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1345/2689] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:12.804289 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c796f3-9cb9-4307-b6dd-d0db2f35f236 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:12.807848 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-92c796f3-9cb9-4307-b6dd-d0db2f35f236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:12.919372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c796f3-9cb9-4307-b6dd-d0db2f35f236 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:12.925986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d95358-689e-42a1-a45e-788a87bc288c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:12.927193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d95358-689e-42a1-a45e-788a87bc288c service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:12.927712 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d95358-689e-42a1-a45e-788a87bc288c service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:12.928173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d95358-689e-42a1-a45e-788a87bc288c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:12.954135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d95358-689e-42a1-a45e-788a87bc288c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:12.957158 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d95358-689e-42a1-a45e-788a87bc288c service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:12.979567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1345/2690] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:08:13.504315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f5405-4c89-4b1e-879a-fd9238cd19a1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:13.580404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f5405-4c89-4b1e-879a-fd9238cd19a1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:13.585290 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:13.586449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:13.586734 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:13.587014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] PATH_INFO: `/v3/users/672a1c3513884640a75594e24d04e0b2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:13.588378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] RBAC: Authorizing `identity:delete_user(user_id=672a1c3513884640a75594e24d04e0b2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:13.590362 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:13.647197 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672a1c3513884640a75594e24d04e0b2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:13.649356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:13.672324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672a1c3513884640a75594e24d04e0b2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:13.683753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672a1c3513884640a75594e24d04e0b2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:13.684809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672a1c3513884640a75594e24d04e0b2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:13.697484 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672a1c3513884640a75594e24d04e0b2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:13.711678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1346/2691] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:08:13 2022] DELETE /identity/v3/users/672a1c3513884640a75594e24d04e0b2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:13.717159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ebcc0-072c-47de-b122-7a562425eaf3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:13.717734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ebcc0-072c-47de-b122-7a562425eaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:13.717835 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ebcc0-072c-47de-b122-7a562425eaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:13.742242 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-a80ebcc0-072c-47de-b122-7a562425eaf3 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:13.744473 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a80ebcc0-072c-47de-b122-7a562425eaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:13.852872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1346/2692] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:13.867774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:13.870107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:13.981952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1f65-a54e-49d0-b89d-f8ad76e123e8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:13.982515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1f65-a54e-49d0-b89d-f8ad76e123e8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:13.982814 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b1f65-a54e-49d0-b89d-f8ad76e123e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:13.986907 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f088-3bbd-433d-b3e9-15a7f959814d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:13.993903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fcbb5-af3e-4f47-8185-0402ce3f27df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:13.995218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fcbb5-af3e-4f47-8185-0402ce3f27df service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:13.995465 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fcbb5-af3e-4f47-8185-0402ce3f27df service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:13.995902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fcbb5-af3e-4f47-8185-0402ce3f27df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:14.004979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4b9b1f65-a54e-49d0-b89d-f8ad76e123e8 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:14.009545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4b9b1f65-a54e-49d0-b89d-f8ad76e123e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:14.024002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fcbb5-af3e-4f47-8185-0402ce3f27df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:14.028113 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fcbb5-af3e-4f47-8185-0402ce3f27df service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:14.045382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1347/2693] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:08:14.137193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1347/2694] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jun 21 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:08:14.165120 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fcbb5-af3e-4f47-8185-0402ce3f27df service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:14.167567 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-157fcbb5-af3e-4f47-8185-0402ce3f27df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:14.261274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f6e04-8038-4935-9a59-779981b9b0a2 None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:14.262150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f6e04-8038-4935-9a59-779981b9b0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:14.262840 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f6e04-8038-4935-9a59-779981b9b0a2 None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:14.266550 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1348/2695] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 16:08:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:08:14.276235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401a01-0a76-4946-a794-eab8483a9a96 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:14.276870 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401a01-0a76-4946-a794-eab8483a9a96 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:14.277467 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401a01-0a76-4946-a794-eab8483a9a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:14.300042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fcbb5-af3e-4f47-8185-0402ce3f27df service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:14.314284 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4c4cc-84c5-4b6c-adf7-2bb3f2a0bdb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:14.315434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4c4cc-84c5-4b6c-adf7-2bb3f2a0bdb4 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:14.315913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4c4cc-84c5-4b6c-adf7-2bb3f2a0bdb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:14.316444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4c4cc-84c5-4b6c-adf7-2bb3f2a0bdb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:14.324587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-67401a01-0a76-4946-a794-eab8483a9a96 None None] MFA Rules not processed for user `2d3018419d0548eda04b3539681f3df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:14.327200 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-67401a01-0a76-4946-a794-eab8483a9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:14.333747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4c4cc-84c5-4b6c-adf7-2bb3f2a0bdb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:14.336457 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4c4cc-84c5-4b6c-adf7-2bb3f2a0bdb4 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:14.347526 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1349/2696] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 16:08:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:08:14.354620 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1348/2697] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:08:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:08:14.370770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67401a01-0a76-4946-a794-eab8483a9a96 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:14.384610 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-67401a01-0a76-4946-a794-eab8483a9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:14.422546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67401a01-0a76-4946-a794-eab8483a9a96 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:14.431908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e601b8-754f-4189-bc59-10dbf73c8ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:14.433273 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e601b8-754f-4189-bc59-10dbf73c8ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:14.433781 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e601b8-754f-4189-bc59-10dbf73c8ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:14.434293 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e601b8-754f-4189-bc59-10dbf73c8ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:14.451754 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e601b8-754f-4189-bc59-10dbf73c8ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:14.454681 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e601b8-754f-4189-bc59-10dbf73c8ed9 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:14.476463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1350/2698] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:08:14.665436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d9b41-5e4c-424c-89e8-37168c0f58a2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:14.666000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d9b41-5e4c-424c-89e8-37168c0f58a2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:14.666221 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d9b41-5e4c-424c-89e8-37168c0f58a2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:14.669801 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1349/2699] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 16:08:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:08:14.679423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10a3bd-ea27-4fde-8ec6-db179db94e14 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:14.679881 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10a3bd-ea27-4fde-8ec6-db179db94e14 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:14.680188 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10a3bd-ea27-4fde-8ec6-db179db94e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:14.704033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d9b41-5e4c-424c-89e8-37168c0f58a2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:14.706331 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d38d9b41-5e4c-424c-89e8-37168c0f58a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:14.713233 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-9f10a3bd-ea27-4fde-8ec6-db179db94e14 None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:14.715933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9f10a3bd-ea27-4fde-8ec6-db179db94e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:14.730259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d9b41-5e4c-424c-89e8-37168c0f58a2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:14.737713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:14.738627 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:14.738904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:14.739236 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] PATH_INFO: `/v3/projects/6929ef48529e47beb464b860dda309c7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:14.740656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6929ef48529e47beb464b860dda309c7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:14.743144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:14.749458 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:14.808911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6929ef48529e47beb464b860dda309c7', 'request_id': 'req-0cd8276c-6c08-43b1-b886-27f74d614518'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:14.811410 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:14.822052 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6929ef48529e47beb464b860dda309c7', 'request_id': 'req-0cd8276c-6c08-43b1-b886-27f74d614518'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:14.836172 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6929ef48529e47beb464b860dda309c7', 'request_id': 'req-0cd8276c-6c08-43b1-b886-27f74d614518'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:14.861015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] The token cache is being invalidate because project 6929ef48529e47beb464b860dda309c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:08:14.862066 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:14.863663 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:14.868967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1350/2700] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:08:14 2022] DELETE /identity/v3/projects/6929ef48529e47beb464b860dda309c7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:08:14.873860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:14.876563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:14.878507 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1351/2701] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 16:08:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:14.894214 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10a3bd-ea27-4fde-8ec6-db179db94e14 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:14.897797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9f10a3bd-ea27-4fde-8ec6-db179db94e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:14.917595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10a3bd-ea27-4fde-8ec6-db179db94e14 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:14.988537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8276c-6c08-43b1-b886-27f74d614518 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:14.996459 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:14.998150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:14.998684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:14.999130 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] PATH_INFO: `/v3/users/3fbd65dbc0184db2bd520991e5529fe5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:15.002262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbd65dbc0184db2bd520991e5529fe5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:15.005011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:15.045826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76cc17-907f-4f06-b7da-45b33761fbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:15.047072 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76cc17-907f-4f06-b7da-45b33761fbba service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:15.047670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76cc17-907f-4f06-b7da-45b33761fbba service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:15.048419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76cc17-907f-4f06-b7da-45b33761fbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:15.083132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbd65dbc0184db2bd520991e5529fe5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:15.105367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbd65dbc0184db2bd520991e5529fe5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:15.119606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbd65dbc0184db2bd520991e5529fe5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:15.120433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbd65dbc0184db2bd520991e5529fe5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:15.133781 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbd65dbc0184db2bd520991e5529fe5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:15.143562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1351/2702] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:08:14 2022] DELETE /identity/v3/users/3fbd65dbc0184db2bd520991e5529fe5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:08:15.183246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76cc17-907f-4f06-b7da-45b33761fbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:15.185302 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76cc17-907f-4f06-b7da-45b33761fbba service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:15.202814 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1352/2703] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:08:15.738941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:15.742612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:15.961132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b445cb-2cb8-40b9-824b-3762e58b2e9c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:15.966868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:15.967852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:15.968139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:15.968414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] PATH_INFO: `/v3/projects/981beb4475e9473db953a7dfc768cce8` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:15.969863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981beb4475e9473db953a7dfc768cce8)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:15.971920 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:15.973855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:16.052081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981beb4475e9473db953a7dfc768cce8', 'request_id': 'req-ed458a35-bb96-4c5d-93f2-65404114fc01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:16.060891 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981beb4475e9473db953a7dfc768cce8', 'request_id': 'req-ed458a35-bb96-4c5d-93f2-65404114fc01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:16.070569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981beb4475e9473db953a7dfc768cce8', 'request_id': 'req-ed458a35-bb96-4c5d-93f2-65404114fc01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:16.090998 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] The token cache is being invalidate because project 981beb4475e9473db953a7dfc768cce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:08:16.091488 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:16.092874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ed458a35-bb96-4c5d-93f2-65404114fc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:16.096311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1352/2704] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:08:15 2022] DELETE /identity/v3/projects/981beb4475e9473db953a7dfc768cce8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:16.102571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7c315-a2af-4114-a901-e3d6dc0b4c31 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:16.103493 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7c315-a2af-4114-a901-e3d6dc0b4c31 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:16.103849 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7c315-a2af-4114-a901-e3d6dc0b4c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:16.129421 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-56b7c315-a2af-4114-a901-e3d6dc0b4c31 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:16.130917 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-56b7c315-a2af-4114-a901-e3d6dc0b4c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:16.202291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=100 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:16.221833 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1353/2705] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:16.231674 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1bf41-c77c-4907-96f0-9eff652b1fa0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:16.231953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1bf41-c77c-4907-96f0-9eff652b1fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:16.232233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1bf41-c77c-4907-96f0-9eff652b1fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:16.253146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d3c1bf41-c77c-4907-96f0-9eff652b1fa0 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:16.254385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d3c1bf41-c77c-4907-96f0-9eff652b1fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:16.265796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1353/2706] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:16.270934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7c315-a2af-4114-a901-e3d6dc0b4c31 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:16.281894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7c315-a2af-4114-a901-e3d6dc0b4c31 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:16.287419 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7d08b-ae6c-4139-b019-70c2dfdbb4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:16.288550 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7d08b-ae6c-4139-b019-70c2dfdbb4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:16.288909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7d08b-ae6c-4139-b019-70c2dfdbb4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:16.289263 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7d08b-ae6c-4139-b019-70c2dfdbb4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:16.290113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7d08b-ae6c-4139-b019-70c2dfdbb4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:08:16.290502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7d08b-ae6c-4139-b019-70c2dfdbb4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:16.292379 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7d08b-ae6c-4139-b019-70c2dfdbb4ae admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:16.309825 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1354/2707] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:08:16.314363 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1bf41-c77c-4907-96f0-9eff652b1fa0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:16.326177 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1bf41-c77c-4907-96f0-9eff652b1fa0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:16.332514 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ac661-6a2c-4b85-9af1-05ce6fc41915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:16.333267 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac661-6a2c-4b85-9af1-05ce6fc41915 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:16.333611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac661-6a2c-4b85-9af1-05ce6fc41915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:16.333972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac661-6a2c-4b85-9af1-05ce6fc41915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:16.336423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ac661-6a2c-4b85-9af1-05ce6fc41915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:16.339068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ac661-6a2c-4b85-9af1-05ce6fc41915 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:16.374785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1354/2708] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:08:16 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:16.379855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7d08b-ae6c-4139-b019-70c2dfdbb4ae admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:16.397896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7d08b-ae6c-4139-b019-70c2dfdbb4ae admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:16.477597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e408-33b7-4689-8c5d-616c49cf2a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:16.478338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e408-33b7-4689-8c5d-616c49cf2a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:16.478741 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e408-33b7-4689-8c5d-616c49cf2a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:16.479120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e408-33b7-4689-8c5d-616c49cf2a96 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:16.480083 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e408-33b7-4689-8c5d-616c49cf2a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:16.482204 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e408-33b7-4689-8c5d-616c49cf2a96 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:16.505896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1355/2709] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:08:16 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:16.512081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ac661-6a2c-4b85-9af1-05ce6fc41915 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:16.525972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ac661-6a2c-4b85-9af1-05ce6fc41915 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:16.532609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22af1e-ebf3-48af-85d9-464cbee0e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:16.533465 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22af1e-ebf3-48af-85d9-464cbee0e11b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:16.533818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22af1e-ebf3-48af-85d9-464cbee0e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:16.534254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22af1e-ebf3-48af-85d9-464cbee0e11b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:16.535372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22af1e-ebf3-48af-85d9-464cbee0e11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:16.537196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22af1e-ebf3-48af-85d9-464cbee0e11b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:16.549937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1355/2710] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:08:16.557241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e408-33b7-4689-8c5d-616c49cf2a96 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:16.577614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e408-33b7-4689-8c5d-616c49cf2a96 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:16.585098 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41b734-871f-48cf-8f20-d21733d62871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:16.585955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41b734-871f-48cf-8f20-d21733d62871 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:16.586376 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41b734-871f-48cf-8f20-d21733d62871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:16.586715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41b734-871f-48cf-8f20-d21733d62871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:16.587639 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41b734-871f-48cf-8f20-d21733d62871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:16.589983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41b734-871f-48cf-8f20-d21733d62871 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:16.606460 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1356/2711] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:08:16.612278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22af1e-ebf3-48af-85d9-464cbee0e11b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:16.627528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22af1e-ebf3-48af-85d9-464cbee0e11b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:16.634526 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49342da3-4b13-4ab3-913e-3567798df490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:16.635607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342da3-4b13-4ab3-913e-3567798df490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:16.635957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342da3-4b13-4ab3-913e-3567798df490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:16.636332 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342da3-4b13-4ab3-913e-3567798df490 admin admin] PATH_INFO: `/v3/projects/5c446b7ba0cf476e9f666a006a1f0c8a/users/fab5b5baaa0947908bc5e4c0ebf3617e/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:16.655763 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49342da3-4b13-4ab3-913e-3567798df490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c446b7ba0cf476e9f666a006a1f0c8a, user_id=fab5b5baaa0947908bc5e4c0ebf3617e, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:16.658588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49342da3-4b13-4ab3-913e-3567798df490 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:16.681695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1356/2712] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:08:16 2022] PUT /identity/v3/projects/5c446b7ba0cf476e9f666a006a1f0c8a/users/fab5b5baaa0947908bc5e4c0ebf3617e/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:08:16.702746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf197a-3c94-4e3b-b412-160919a41d6b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:16.703326 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf197a-3c94-4e3b-b412-160919a41d6b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:16.703852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf197a-3c94-4e3b-b412-160919a41d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:16.763275 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-28cf197a-3c94-4e3b-b412-160919a41d6b None None] MFA Rules not processed for user `fab5b5baaa0947908bc5e4c0ebf3617e`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:16.765374 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-28cf197a-3c94-4e3b-b412-160919a41d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:16.877489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1357/2713] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:16.884301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49342da3-4b13-4ab3-913e-3567798df490 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:16.988860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49342da3-4b13-4ab3-913e-3567798df490 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:16.995807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9623-9d71-445b-b7c0-7d5a55d3767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:16.996856 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9623-9d71-445b-b7c0-7d5a55d3767d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:16.997325 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9623-9d71-445b-b7c0-7d5a55d3767d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:16.997747 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9623-9d71-445b-b7c0-7d5a55d3767d admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:16.998861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e9623-9d71-445b-b7c0-7d5a55d3767d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:17.001656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e9623-9d71-445b-b7c0-7d5a55d3767d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:17.039498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1357/2714] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:08:16 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:17.044864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf197a-3c94-4e3b-b412-160919a41d6b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:17.059562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf197a-3c94-4e3b-b412-160919a41d6b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:17.118999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:17.141985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e915a3-9abd-4102-95ee-a8773c55637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:17.143548 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e915a3-9abd-4102-95ee-a8773c55637f admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:17.144436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e915a3-9abd-4102-95ee-a8773c55637f admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:17.145031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e915a3-9abd-4102-95ee-a8773c55637f admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:17.146383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e915a3-9abd-4102-95ee-a8773c55637f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:17.153651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e915a3-9abd-4102-95ee-a8773c55637f admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:17.187283 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1358/2715] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:08:17 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:17.193085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9623-9d71-445b-b7c0-7d5a55d3767d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:17.212295 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9623-9d71-445b-b7c0-7d5a55d3767d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:17.219575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f2441-375c-4a76-bc92-cd8f7c15a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:17.220278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2441-375c-4a76-bc92-cd8f7c15a44c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:17.220564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2441-375c-4a76-bc92-cd8f7c15a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:17.220845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2441-375c-4a76-bc92-cd8f7c15a44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:17.221632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f2441-375c-4a76-bc92-cd8f7c15a44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:17.223293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f2441-375c-4a76-bc92-cd8f7c15a44c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:17.231144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:17.238874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1358/2716] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:08:17.245636 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e915a3-9abd-4102-95ee-a8773c55637f admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:17.258879 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e915a3-9abd-4102-95ee-a8773c55637f admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:17.265032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8272259-e161-4372-8b34-9f08ca4f3276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:17.265900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8272259-e161-4372-8b34-9f08ca4f3276 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:17.266261 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8272259-e161-4372-8b34-9f08ca4f3276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:17.266524 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8272259-e161-4372-8b34-9f08ca4f3276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:17.267255 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8272259-e161-4372-8b34-9f08ca4f3276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:17.269228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8272259-e161-4372-8b34-9f08ca4f3276 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:17.282863 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1359/2717] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:08:17.289601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f2441-375c-4a76-bc92-cd8f7c15a44c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:17.310485 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f2441-375c-4a76-bc92-cd8f7c15a44c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:17.317073 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068bf7f-a7e8-42fc-8a15-429c5cc1372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:17.318016 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068bf7f-a7e8-42fc-8a15-429c5cc1372e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:17.318306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068bf7f-a7e8-42fc-8a15-429c5cc1372e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:17.318602 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068bf7f-a7e8-42fc-8a15-429c5cc1372e admin admin] PATH_INFO: `/v3/projects/4d56144960134aa6b209312f19479f49/users/bb4c6c415c8d4fe6bea3d37e4a133ddc/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:17.340303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068bf7f-a7e8-42fc-8a15-429c5cc1372e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d56144960134aa6b209312f19479f49, user_id=bb4c6c415c8d4fe6bea3d37e4a133ddc, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:17.343439 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068bf7f-a7e8-42fc-8a15-429c5cc1372e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:17.359694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1359/2718] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:08:17 2022] PUT /identity/v3/projects/4d56144960134aa6b209312f19479f49/users/bb4c6c415c8d4fe6bea3d37e4a133ddc/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:08:17.374380 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81311c-4189-407e-bfcb-bae3ffa156e5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:17.374764 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81311c-4189-407e-bfcb-bae3ffa156e5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:17.375113 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81311c-4189-407e-bfcb-bae3ffa156e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:17.420081 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1e81311c-4189-407e-bfcb-bae3ffa156e5 None None] MFA Rules not processed for user `bb4c6c415c8d4fe6bea3d37e4a133ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:17.422508 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1e81311c-4189-407e-bfcb-bae3ffa156e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:17.520377 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1360/2719] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:17.525513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068bf7f-a7e8-42fc-8a15-429c5cc1372e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:17.638435 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068bf7f-a7e8-42fc-8a15-429c5cc1372e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:17.649017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1523157-89d3-4040-86db-ee32219e5fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:17.650118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523157-89d3-4040-86db-ee32219e5fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:17.650670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523157-89d3-4040-86db-ee32219e5fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:17.651211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523157-89d3-4040-86db-ee32219e5fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:17.652625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1523157-89d3-4040-86db-ee32219e5fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:17.656547 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1523157-89d3-4040-86db-ee32219e5fb1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:17.697307 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1360/2720] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:08:17 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:17.701608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81311c-4189-407e-bfcb-bae3ffa156e5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:17.715517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81311c-4189-407e-bfcb-bae3ffa156e5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:17.808195 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf969228-446f-4ed9-9b7b-160cf83e35f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:17.809021 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf969228-446f-4ed9-9b7b-160cf83e35f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:17.809349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf969228-446f-4ed9-9b7b-160cf83e35f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:17.809637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf969228-446f-4ed9-9b7b-160cf83e35f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:17.810432 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf969228-446f-4ed9-9b7b-160cf83e35f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:17.812667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf969228-446f-4ed9-9b7b-160cf83e35f4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:17.838709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1361/2721] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:08:17 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:08:17.844714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1523157-89d3-4040-86db-ee32219e5fb1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:17.857067 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1523157-89d3-4040-86db-ee32219e5fb1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:17.862941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bab322-5ee3-4e2a-886d-90cacdc6a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:17.863725 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bab322-5ee3-4e2a-886d-90cacdc6a450 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:17.864012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bab322-5ee3-4e2a-886d-90cacdc6a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:17.864293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bab322-5ee3-4e2a-886d-90cacdc6a450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:17.865072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bab322-5ee3-4e2a-886d-90cacdc6a450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:17.866957 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bab322-5ee3-4e2a-886d-90cacdc6a450 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:17.879982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1361/2722] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:08:17.885613 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf969228-446f-4ed9-9b7b-160cf83e35f4 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:17.903640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf969228-446f-4ed9-9b7b-160cf83e35f4 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:17.909040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98ab5-8ddb-4bc9-8b0d-b93d1557dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:17.909986 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98ab5-8ddb-4bc9-8b0d-b93d1557dc31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:17.910276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98ab5-8ddb-4bc9-8b0d-b93d1557dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:17.910561 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98ab5-8ddb-4bc9-8b0d-b93d1557dc31 admin admin] PATH_INFO: `/v3/projects/4a0749aae6a84a08888b619904abb711/users/a552d01c9ff74e3c90f821f323607cda/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:17.929708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98ab5-8ddb-4bc9-8b0d-b93d1557dc31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0749aae6a84a08888b619904abb711, user_id=a552d01c9ff74e3c90f821f323607cda, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:17.933128 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98ab5-8ddb-4bc9-8b0d-b93d1557dc31 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:17.950232 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1362/2723] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:08:17 2022] PUT /identity/v3/projects/4a0749aae6a84a08888b619904abb711/users/a552d01c9ff74e3c90f821f323607cda/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:17.954953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bab322-5ee3-4e2a-886d-90cacdc6a450 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:17.966516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bab322-5ee3-4e2a-886d-90cacdc6a450 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:18.044739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca74f7d-fea3-42cf-a6d5-7dadc3e384a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:18.046304 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca74f7d-fea3-42cf-a6d5-7dadc3e384a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:18.046688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca74f7d-fea3-42cf-a6d5-7dadc3e384a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:18.047104 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca74f7d-fea3-42cf-a6d5-7dadc3e384a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:18.048100 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca74f7d-fea3-42cf-a6d5-7dadc3e384a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:18.050093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca74f7d-fea3-42cf-a6d5-7dadc3e384a3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:18.063442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1362/2724] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:08:18.068386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98ab5-8ddb-4bc9-8b0d-b93d1557dc31 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:18.081267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98ab5-8ddb-4bc9-8b0d-b93d1557dc31 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:18.087134 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345850cf-bc47-4d78-a1b3-e99842f9f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:18.088111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345850cf-bc47-4d78-a1b3-e99842f9f59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:18.088401 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345850cf-bc47-4d78-a1b3-e99842f9f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:18.088693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345850cf-bc47-4d78-a1b3-e99842f9f59a admin admin] PATH_INFO: `/v3/projects/4a0749aae6a84a08888b619904abb711/users/a552d01c9ff74e3c90f821f323607cda/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:18.090979 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345850cf-bc47-4d78-a1b3-e99842f9f59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0749aae6a84a08888b619904abb711, user_id=a552d01c9ff74e3c90f821f323607cda, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:18.093795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345850cf-bc47-4d78-a1b3-e99842f9f59a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:18.107244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1363/2725] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:08:18 2022] PUT /identity/v3/projects/4a0749aae6a84a08888b619904abb711/users/a552d01c9ff74e3c90f821f323607cda/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:08:18.118651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b06e-b31a-4d4d-932a-c1768d7ef978 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:18.119028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b06e-b31a-4d4d-932a-c1768d7ef978 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:18.119412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b06e-b31a-4d4d-932a-c1768d7ef978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:18.151610 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7cb0b06e-b31a-4d4d-932a-c1768d7ef978 None None] MFA Rules not processed for user `a552d01c9ff74e3c90f821f323607cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:18.152892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7cb0b06e-b31a-4d4d-932a-c1768d7ef978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:18.196645 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:18.254181 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1363/2726] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:18.268843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345850cf-bc47-4d78-a1b3-e99842f9f59a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:18.271585 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-345850cf-bc47-4d78-a1b3-e99842f9f59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:18.284945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:18.348054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345850cf-bc47-4d78-a1b3-e99842f9f59a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:18.353243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4fa88-874a-4c9a-952f-97defb80fa53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:18.353955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4fa88-874a-4c9a-952f-97defb80fa53 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:18.354433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4fa88-874a-4c9a-952f-97defb80fa53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:18.354761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4fa88-874a-4c9a-952f-97defb80fa53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:18.366823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4fa88-874a-4c9a-952f-97defb80fa53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:18.367614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4fa88-874a-4c9a-952f-97defb80fa53 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:18.378926 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1364/2727] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:08:18.435256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0b06e-b31a-4d4d-932a-c1768d7ef978 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:18.435256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7cb0b06e-b31a-4d4d-932a-c1768d7ef978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:18.455106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0b06e-b31a-4d4d-932a-c1768d7ef978 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:18.462667 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4a49b-210d-4fa8-a47f-1841d718e053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:18.463785 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4a49b-210d-4fa8-a47f-1841d718e053 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:18.464247 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4a49b-210d-4fa8-a47f-1841d718e053 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:18.464691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4a49b-210d-4fa8-a47f-1841d718e053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:18.577566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4a49b-210d-4fa8-a47f-1841d718e053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:18.579213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4a49b-210d-4fa8-a47f-1841d718e053 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:18.591509 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1364/2728] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:08:21.882688 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4fa88-874a-4c9a-952f-97defb80fa53 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:22.001216 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4fa88-874a-4c9a-952f-97defb80fa53 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:22.012230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:22.013790 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:22.014303 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:22.014803 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] PATH_INFO: `/v3/users/fab5b5baaa0947908bc5e4c0ebf3617e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:22.017241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab5b5baaa0947908bc5e4c0ebf3617e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:22.023545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:22.112515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab5b5baaa0947908bc5e4c0ebf3617e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:22.128372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab5b5baaa0947908bc5e4c0ebf3617e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:22.129150 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab5b5baaa0947908bc5e4c0ebf3617e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:22.142282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab5b5baaa0947908bc5e4c0ebf3617e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:22.148341 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab5b5baaa0947908bc5e4c0ebf3617e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:22.171725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1365/2729] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:08:21 2022] DELETE /identity/v3/users/fab5b5baaa0947908bc5e4c0ebf3617e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:22.180611 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbb95c-7344-4290-9b4e-b41532c17291 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:22.183029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbb95c-7344-4290-9b4e-b41532c17291 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:22.183975 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbb95c-7344-4290-9b4e-b41532c17291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:22.223924 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-34cbb95c-7344-4290-9b4e-b41532c17291 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:22.225256 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-34cbb95c-7344-4290-9b4e-b41532c17291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:22.345248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1365/2730] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:22.357097 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:22.358626 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:22.398632 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:22.435828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6a269-2362-4cd2-9ccb-05ba67fb0874 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:22.440043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13bb36-7bf9-40e2-b7c3-877c24dc06a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:22.440733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13bb36-7bf9-40e2-b7c3-877c24dc06a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:22.441023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13bb36-7bf9-40e2-b7c3-877c24dc06a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:22.441306 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13bb36-7bf9-40e2-b7c3-877c24dc06a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:22.454903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13bb36-7bf9-40e2-b7c3-877c24dc06a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:22.456480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13bb36-7bf9-40e2-b7c3-877c24dc06a3 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:22.468452 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1366/2731] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:08:22.831778 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbb95c-7344-4290-9b4e-b41532c17291 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:22.833548 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-34cbb95c-7344-4290-9b4e-b41532c17291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:22.855813 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbb95c-7344-4290-9b4e-b41532c17291 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:22.861577 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:22.862480 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:22.862760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:22.863239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] PATH_INFO: `/v3/projects/5c446b7ba0cf476e9f666a006a1f0c8a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:22.864483 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c446b7ba0cf476e9f666a006a1f0c8a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:22.867800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:22.932921 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c446b7ba0cf476e9f666a006a1f0c8a', 'request_id': 'req-9cfc3332-191e-44ce-995c-ecea5ca118b6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:22.944311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c446b7ba0cf476e9f666a006a1f0c8a', 'request_id': 'req-9cfc3332-191e-44ce-995c-ecea5ca118b6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:22.951546 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c446b7ba0cf476e9f666a006a1f0c8a', 'request_id': 'req-9cfc3332-191e-44ce-995c-ecea5ca118b6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:22.954597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:22.973954 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] The token cache is being invalidate because project 5c446b7ba0cf476e9f666a006a1f0c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:08:22.974405 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:22.975563 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:22.977903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1366/2732] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:08:22 2022] DELETE /identity/v3/projects/5c446b7ba0cf476e9f666a006a1f0c8a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:08:22.982463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13bb36-7bf9-40e2-b7c3-877c24dc06a3 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:22.994759 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13bb36-7bf9-40e2-b7c3-877c24dc06a3 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:23.063842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:23.064894 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:23.065341 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:23.065724 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] PATH_INFO: `/v3/users/bb4c6c415c8d4fe6bea3d37e4a133ddc` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:23.067108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4c6c415c8d4fe6bea3d37e4a133ddc)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:23.070244 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:23.128435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4c6c415c8d4fe6bea3d37e4a133ddc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:23.142019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4c6c415c8d4fe6bea3d37e4a133ddc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:23.142768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4c6c415c8d4fe6bea3d37e4a133ddc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:23.151603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4c6c415c8d4fe6bea3d37e4a133ddc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:23.152413 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4c6c415c8d4fe6bea3d37e4a133ddc'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:23.170032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1367/2733] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:08:22 2022] DELETE /identity/v3/users/bb4c6c415c8d4fe6bea3d37e4a133ddc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:23.650063 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:23.652154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:23.675711 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc3332-191e-44ce-995c-ecea5ca118b6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:23.755599 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:23.757694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:23.758015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:23.758301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] PATH_INFO: `/v3/projects/4d56144960134aa6b209312f19479f49` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:23.759969 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d56144960134aa6b209312f19479f49)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:23.761943 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:23.823582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d56144960134aa6b209312f19479f49', 'request_id': 'req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:23.830829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d56144960134aa6b209312f19479f49', 'request_id': 'req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:23.838139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d56144960134aa6b209312f19479f49', 'request_id': 'req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:23.856255 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] The token cache is being invalidate because project 4d56144960134aa6b209312f19479f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:08:23.856687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:23.857508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:23.859384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1367/2734] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:08:23 2022] DELETE /identity/v3/projects/4d56144960134aa6b209312f19479f49 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:23.863822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:23.866327 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:23.881280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d385c3-805d-435a-a64a-a92f13fa8734 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:23.952271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:23.974937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:23.976981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:23.977449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:23.977850 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] PATH_INFO: `/v3/users/a552d01c9ff74e3c90f821f323607cda` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:23.980198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a552d01c9ff74e3c90f821f323607cda)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:23.983606 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:24.069837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a552d01c9ff74e3c90f821f323607cda'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:24.086239 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a552d01c9ff74e3c90f821f323607cda'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:24.087024 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a552d01c9ff74e3c90f821f323607cda'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:24.096808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a552d01c9ff74e3c90f821f323607cda'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:24.097667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a15a5abf-d229-48c9-97a5-c94100020684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a552d01c9ff74e3c90f821f323607cda'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:24.117990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1368/2735] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:08:23 2022] DELETE /identity/v3/users/a552d01c9ff74e3c90f821f323607cda => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:24.437098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:24.438768 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:24.456816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47192fad-60e1-4b5e-9f4f-dfedab9c8ea0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:24.531143 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:24.532644 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:24.533231 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:24.533769 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] PATH_INFO: `/v3/projects/4a0749aae6a84a08888b619904abb711` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:24.536021 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0749aae6a84a08888b619904abb711)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:24.539670 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:24.596956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:24.622371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0749aae6a84a08888b619904abb711', 'request_id': 'req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:24.630527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0749aae6a84a08888b619904abb711', 'request_id': 'req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:24.637869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0749aae6a84a08888b619904abb711', 'request_id': 'req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:24.652265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] The token cache is being invalidate because project 4a0749aae6a84a08888b619904abb711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:08:24.653276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:24.653276 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b945943b-8c04-4ba4-8dc9-1af4ebbe9a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:24.655057 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1368/2736] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:08:24 2022] DELETE /identity/v3/projects/4a0749aae6a84a08888b619904abb711 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:24.664471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73906e-ac80-4482-ab57-add5a1a1564b None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:24.664944 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73906e-ac80-4482-ab57-add5a1a1564b None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:24.665877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73906e-ac80-4482-ab57-add5a1a1564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:24.694976 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fe73906e-ac80-4482-ab57-add5a1a1564b None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:24.696982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fe73906e-ac80-4482-ab57-add5a1a1564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:24.796566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1369/2737] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:24.808214 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387dd13-1dd0-4b33-9c72-386dd6c642d6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:24.808990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387dd13-1dd0-4b33-9c72-386dd6c642d6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:24.809664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387dd13-1dd0-4b33-9c72-386dd6c642d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:24.839810 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c387dd13-1dd0-4b33-9c72-386dd6c642d6 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:24.841187 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c387dd13-1dd0-4b33-9c72-386dd6c642d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:24.854874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1369/2738] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:24.856203 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73906e-ac80-4482-ab57-add5a1a1564b None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:24.874515 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73906e-ac80-4482-ab57-add5a1a1564b None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:24.880127 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab70754-2931-455b-a3fd-87d4514eba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:24.880973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab70754-2931-455b-a3fd-87d4514eba78 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:24.881925 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab70754-2931-455b-a3fd-87d4514eba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:24.882449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab70754-2931-455b-a3fd-87d4514eba78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:24.883262 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab70754-2931-455b-a3fd-87d4514eba78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:08:24.883715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab70754-2931-455b-a3fd-87d4514eba78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:24.885500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab70754-2931-455b-a3fd-87d4514eba78 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:24.899920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1370/2739] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:08:24.906158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387dd13-1dd0-4b33-9c72-386dd6c642d6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:24.918750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387dd13-1dd0-4b33-9c72-386dd6c642d6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:24.927288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c40866-d8d2-4438-9a34-7e2d8e59a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:24.928479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c40866-d8d2-4438-9a34-7e2d8e59a21c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:24.928973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c40866-d8d2-4438-9a34-7e2d8e59a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:24.929481 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c40866-d8d2-4438-9a34-7e2d8e59a21c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:24.930745 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c40866-d8d2-4438-9a34-7e2d8e59a21c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:24.934322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c40866-d8d2-4438-9a34-7e2d8e59a21c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:24.975250 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1370/2740] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:08:24 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:24.981274 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab70754-2931-455b-a3fd-87d4514eba78 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:24.993189 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab70754-2931-455b-a3fd-87d4514eba78 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:25.054913 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:25.062938 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d333461-e6ff-4dc3-9360-61b4ef6796cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:25.064086 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333461-e6ff-4dc3-9360-61b4ef6796cc admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:25.064598 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333461-e6ff-4dc3-9360-61b4ef6796cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:25.064955 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333461-e6ff-4dc3-9360-61b4ef6796cc admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:25.066372 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d333461-e6ff-4dc3-9360-61b4ef6796cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:25.069130 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d333461-e6ff-4dc3-9360-61b4ef6796cc admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:25.092553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1371/2741] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:08:24 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:08:25.099196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c40866-d8d2-4438-9a34-7e2d8e59a21c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:25.111497 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c40866-d8d2-4438-9a34-7e2d8e59a21c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:25.119908 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734727cb-7ffa-45a5-890a-de599b1afb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:25.120989 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734727cb-7ffa-45a5-890a-de599b1afb89 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:25.121324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734727cb-7ffa-45a5-890a-de599b1afb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:25.121819 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734727cb-7ffa-45a5-890a-de599b1afb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:25.122616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734727cb-7ffa-45a5-890a-de599b1afb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:25.124516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734727cb-7ffa-45a5-890a-de599b1afb89 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:25.137675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1371/2742] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:08:25.142055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d333461-e6ff-4dc3-9360-61b4ef6796cc admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:25.153963 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d333461-e6ff-4dc3-9360-61b4ef6796cc admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:25.159145 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5addc1-2bb9-4b04-bd33-7d0f5465f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:25.160742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5addc1-2bb9-4b04-bd33-7d0f5465f418 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:25.160742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5addc1-2bb9-4b04-bd33-7d0f5465f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:25.160742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5addc1-2bb9-4b04-bd33-7d0f5465f418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:25.161228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5addc1-2bb9-4b04-bd33-7d0f5465f418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:25.163027 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5addc1-2bb9-4b04-bd33-7d0f5465f418 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:25.174366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1372/2743] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:08:25.179245 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734727cb-7ffa-45a5-890a-de599b1afb89 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:25.190107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734727cb-7ffa-45a5-890a-de599b1afb89 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:25.195890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ab832-7e65-496c-9c9d-84147fda5f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:25.196805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ab832-7e65-496c-9c9d-84147fda5f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:25.197089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ab832-7e65-496c-9c9d-84147fda5f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:25.197367 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ab832-7e65-496c-9c9d-84147fda5f35 admin admin] PATH_INFO: `/v3/projects/34bcb82e13b3417288818df62105d628/users/6a0953ef301341e38b17d48fb6236203/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:25.215753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ab832-7e65-496c-9c9d-84147fda5f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bcb82e13b3417288818df62105d628, user_id=6a0953ef301341e38b17d48fb6236203, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:25.218739 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ab832-7e65-496c-9c9d-84147fda5f35 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:25.234713 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1372/2744] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:08:25 2022] PUT /identity/v3/projects/34bcb82e13b3417288818df62105d628/users/6a0953ef301341e38b17d48fb6236203/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:25.248836 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7e69c-be61-4e5a-a773-7584fe812ee8 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:25.249210 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7e69c-be61-4e5a-a773-7584fe812ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:25.249599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7e69c-be61-4e5a-a773-7584fe812ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:25.282742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-91d7e69c-be61-4e5a-a773-7584fe812ee8 None None] MFA Rules not processed for user `6a0953ef301341e38b17d48fb6236203`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:25.284110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-91d7e69c-be61-4e5a-a773-7584fe812ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:25.366471 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1373/2745] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:25.380083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ab832-7e65-496c-9c9d-84147fda5f35 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:25.384170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8b6ab832-7e65-496c-9c9d-84147fda5f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:25.473153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ab832-7e65-496c-9c9d-84147fda5f35 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:25.481443 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb967f3-cf95-4fc7-b5ac-4a443b541af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:25.482497 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb967f3-cf95-4fc7-b5ac-4a443b541af6 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:25.482950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb967f3-cf95-4fc7-b5ac-4a443b541af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:25.483449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb967f3-cf95-4fc7-b5ac-4a443b541af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:25.500635 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb967f3-cf95-4fc7-b5ac-4a443b541af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:25.503461 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb967f3-cf95-4fc7-b5ac-4a443b541af6 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:25.521719 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1373/2746] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:08:25.544857 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7e69c-be61-4e5a-a773-7584fe812ee8 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:25.645019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7e69c-be61-4e5a-a773-7584fe812ee8 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:25.651030 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:25.651975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:25.652265 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:25.652546 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] PATH_INFO: `/v3/users/6a0953ef301341e38b17d48fb6236203` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:25.653847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0953ef301341e38b17d48fb6236203)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:25.655902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:25.721271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0953ef301341e38b17d48fb6236203'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:25.739310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0953ef301341e38b17d48fb6236203'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:25.740479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0953ef301341e38b17d48fb6236203'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:25.745640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:25.755844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0953ef301341e38b17d48fb6236203'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:25.758106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0953ef301341e38b17d48fb6236203'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:25.780612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1374/2747] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:08:25 2022] DELETE /identity/v3/users/6a0953ef301341e38b17d48fb6236203 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:08:25.786906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba517c-0e69-43ed-af1a-ae58a786bf62 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:25.788682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba517c-0e69-43ed-af1a-ae58a786bf62 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:25.788682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba517c-0e69-43ed-af1a-ae58a786bf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:25.810110 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-21ba517c-0e69-43ed-af1a-ae58a786bf62 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:25.811407 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21ba517c-0e69-43ed-af1a-ae58a786bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:25.872431 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:25.896333 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1374/2748] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:25.909594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:25.911191 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:25.991933 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f67f1-d13d-4613-bace-9549ba6079b6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:26.004526 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bd639-a9fe-4ff2-86e8-fe432a28dba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:26.005735 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd639-a9fe-4ff2-86e8-fe432a28dba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:26.006985 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd639-a9fe-4ff2-86e8-fe432a28dba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:26.008256 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd639-a9fe-4ff2-86e8-fe432a28dba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:26.021197 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bd639-a9fe-4ff2-86e8-fe432a28dba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:26.023501 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bd639-a9fe-4ff2-86e8-fe432a28dba8 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:26.034813 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1375/2749] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:08:26.450209 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba517c-0e69-43ed-af1a-ae58a786bf62 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:26.452101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21ba517c-0e69-43ed-af1a-ae58a786bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:26.468450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba517c-0e69-43ed-af1a-ae58a786bf62 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:26.474658 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:26.476569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:26.476961 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:26.477651 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] PATH_INFO: `/v3/projects/34bcb82e13b3417288818df62105d628` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:26.479253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] RBAC: Authorizing `identity:delete_project(project_id=34bcb82e13b3417288818df62105d628)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:26.481665 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:26.546430 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bcb82e13b3417288818df62105d628', 'request_id': 'req-9ac6a48b-affe-4918-96de-0dc2794f883a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:26.555005 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bcb82e13b3417288818df62105d628', 'request_id': 'req-9ac6a48b-affe-4918-96de-0dc2794f883a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:26.562252 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bcb82e13b3417288818df62105d628', 'request_id': 'req-9ac6a48b-affe-4918-96de-0dc2794f883a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:26.578886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] The token cache is being invalidate because project 34bcb82e13b3417288818df62105d628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:08:26.579223 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:26.579950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9ac6a48b-affe-4918-96de-0dc2794f883a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:08:26.581579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1375/2750] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:08:26 2022] DELETE /identity/v3/projects/34bcb82e13b3417288818df62105d628 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:08:26.587997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02d4e-e800-4a0e-bbc5-319d07657d28 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:26.588329 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02d4e-e800-4a0e-bbc5-319d07657d28 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:26.588682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02d4e-e800-4a0e-bbc5-319d07657d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:26.608295 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-0ff02d4e-e800-4a0e-bbc5-319d07657d28 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:26.609567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-0ff02d4e-e800-4a0e-bbc5-319d07657d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:26.710395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1376/2751] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:08:26.712753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7b67-5be1-42ae-bb7b-5d9479d20008 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:26.713211 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7b67-5be1-42ae-bb7b-5d9479d20008 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:26.713639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7b67-5be1-42ae-bb7b-5d9479d20008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:26.737673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f36f7b67-5be1-42ae-bb7b-5d9479d20008 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:26.738941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f36f7b67-5be1-42ae-bb7b-5d9479d20008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:26.748315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1376/2752] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:26.753652 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02d4e-e800-4a0e-bbc5-319d07657d28 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:26.774108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02d4e-e800-4a0e-bbc5-319d07657d28 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:26.782168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d8c1e-c9d1-4f8b-874f-18a6c7383eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:26.783366 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d8c1e-c9d1-4f8b-874f-18a6c7383eef admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:26.783879 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d8c1e-c9d1-4f8b-874f-18a6c7383eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:26.784395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d8c1e-c9d1-4f8b-874f-18a6c7383eef admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:26.785815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d8c1e-c9d1-4f8b-874f-18a6c7383eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:08:26.786411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d8c1e-c9d1-4f8b-874f-18a6c7383eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:26.789616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d8c1e-c9d1-4f8b-874f-18a6c7383eef admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:26.813668 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1377/2753] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:08:26.819450 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f7b67-5be1-42ae-bb7b-5d9479d20008 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:26.829897 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f7b67-5be1-42ae-bb7b-5d9479d20008 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:26.836081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b2287-df84-4b2f-90a1-732d9ed779a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:26.836771 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b2287-df84-4b2f-90a1-732d9ed779a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:26.837061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b2287-df84-4b2f-90a1-732d9ed779a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:26.837370 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b2287-df84-4b2f-90a1-732d9ed779a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:26.838146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b2287-df84-4b2f-90a1-732d9ed779a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:26.840202 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b2287-df84-4b2f-90a1-732d9ed779a8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:26.872702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1377/2754] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:08:26 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:26.877238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d8c1e-c9d1-4f8b-874f-18a6c7383eef admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:26.888675 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d8c1e-c9d1-4f8b-874f-18a6c7383eef admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:26.966643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a45ce-a9d2-4e48-8ec5-04dfa29e7903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:26.967300 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a45ce-a9d2-4e48-8ec5-04dfa29e7903 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:26.967592 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a45ce-a9d2-4e48-8ec5-04dfa29e7903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:26.967875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a45ce-a9d2-4e48-8ec5-04dfa29e7903 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:26.968598 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a45ce-a9d2-4e48-8ec5-04dfa29e7903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:26.970655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a45ce-a9d2-4e48-8ec5-04dfa29e7903 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:26.996982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1378/2755] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:08:26 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:08:27.002301 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b2287-df84-4b2f-90a1-732d9ed779a8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:27.021233 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b2287-df84-4b2f-90a1-732d9ed779a8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:27.029549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b29142-3ba3-4521-a95d-0686b9478768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:27.030607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29142-3ba3-4521-a95d-0686b9478768 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:27.031107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29142-3ba3-4521-a95d-0686b9478768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:27.031582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b29142-3ba3-4521-a95d-0686b9478768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:27.032816 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b29142-3ba3-4521-a95d-0686b9478768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:27.035986 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b29142-3ba3-4521-a95d-0686b9478768 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:27.058281 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1378/2756] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:08:27.062670 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a45ce-a9d2-4e48-8ec5-04dfa29e7903 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:27.074517 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:27.081160 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a45ce-a9d2-4e48-8ec5-04dfa29e7903 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:27.090118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc491068-81a4-4acf-9a7d-695bb4f6cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:27.091100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491068-81a4-4acf-9a7d-695bb4f6cff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:27.091801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491068-81a4-4acf-9a7d-695bb4f6cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:27.092266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491068-81a4-4acf-9a7d-695bb4f6cff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:27.093361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc491068-81a4-4acf-9a7d-695bb4f6cff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:27.095619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc491068-81a4-4acf-9a7d-695bb4f6cff5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:27.113018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1379/2757] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:08:27.118811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b29142-3ba3-4521-a95d-0686b9478768 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:27.129876 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b29142-3ba3-4521-a95d-0686b9478768 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:27.135992 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b8998-a5f8-4f8c-8395-634f338f22c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:27.137462 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b8998-a5f8-4f8c-8395-634f338f22c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:27.137968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b8998-a5f8-4f8c-8395-634f338f22c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:27.138374 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b8998-a5f8-4f8c-8395-634f338f22c8 admin admin] PATH_INFO: `/v3/projects/ca28b03f63b84862b4f0126609ec2219/users/9d48457eca43409798403e56873187dd/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:27.156898 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b8998-a5f8-4f8c-8395-634f338f22c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca28b03f63b84862b4f0126609ec2219, user_id=9d48457eca43409798403e56873187dd, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:27.159736 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b8998-a5f8-4f8c-8395-634f338f22c8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:27.176469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1379/2758] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:08:27 2022] PUT /identity/v3/projects/ca28b03f63b84862b4f0126609ec2219/users/9d48457eca43409798403e56873187dd/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:08:27.188907 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82e6c-77b3-4e3c-bdb1-c18ce0e5800e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:27.189190 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82e6c-77b3-4e3c-bdb1-c18ce0e5800e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:27.189470 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82e6c-77b3-4e3c-bdb1-c18ce0e5800e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:27.224446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-45d82e6c-77b3-4e3c-bdb1-c18ce0e5800e None None] MFA Rules not processed for user `9d48457eca43409798403e56873187dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:08:27.226713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-45d82e6c-77b3-4e3c-bdb1-c18ce0e5800e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:27.306552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1380/2759] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:08:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:08:27.320540 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b8998-a5f8-4f8c-8395-634f338f22c8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:08:27.322444 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d45b8998-a5f8-4f8c-8395-634f338f22c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:08:27.390532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b8998-a5f8-4f8c-8395-634f338f22c8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:08:27.394687 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593be7a5-21c6-4c5f-8874-075becd527d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:08:27.395391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be7a5-21c6-4c5f-8874-075becd527d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:08:27.395684 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be7a5-21c6-4c5f-8874-075becd527d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:08:27.395966 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be7a5-21c6-4c5f-8874-075becd527d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:08:27.409716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593be7a5-21c6-4c5f-8874-075becd527d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:08:27.411220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593be7a5-21c6-4c5f-8874-075becd527d3 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:08:27.422922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1380/2760] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:08:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:08:37.302049 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=35 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:08:37.418029 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:09:02.529708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d82e6c-77b3-4e3c-bdb1-c18ce0e5800e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:02.624418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d82e6c-77b3-4e3c-bdb1-c18ce0e5800e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:02.629134 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:02.630084 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:02.631504 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:02.632243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] PATH_INFO: `/v3/users/9d48457eca43409798403e56873187dd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:02.634163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d48457eca43409798403e56873187dd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:02.636858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:02.700854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d48457eca43409798403e56873187dd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:02.716931 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d48457eca43409798403e56873187dd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:02.717689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d48457eca43409798403e56873187dd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:02.726527 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d48457eca43409798403e56873187dd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:02.727429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d48457eca43409798403e56873187dd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:02.750069 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1381/2761] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:09:02 2022] DELETE /identity/v3/users/9d48457eca43409798403e56873187dd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:09:02.757372 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62919d63-9ebc-4e18-b4d2-bdec17c06e06 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:02.758272 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62919d63-9ebc-4e18-b4d2-bdec17c06e06 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:02.758469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62919d63-9ebc-4e18-b4d2-bdec17c06e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:02.789855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-62919d63-9ebc-4e18-b4d2-bdec17c06e06 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:09:02.792101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62919d63-9ebc-4e18-b4d2-bdec17c06e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:02.908973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1381/2762] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:09:02.918237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:02.920185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:03.019357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebafbd-bc2b-40ff-9046-2be496dbfbde admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:03.025391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e15f00-d055-45b4-bfa5-a1015d033383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:03.026202 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e15f00-d055-45b4-bfa5-a1015d033383 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:03.026653 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e15f00-d055-45b4-bfa5-a1015d033383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:03.027035 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e15f00-d055-45b4-bfa5-a1015d033383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:03.039676 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e15f00-d055-45b4-bfa5-a1015d033383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:03.041644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e15f00-d055-45b4-bfa5-a1015d033383 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:03.058122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1382/2763] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:09:03.426398 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62919d63-9ebc-4e18-b4d2-bdec17c06e06 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:03.428683 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62919d63-9ebc-4e18-b4d2-bdec17c06e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:03.447323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62919d63-9ebc-4e18-b4d2-bdec17c06e06 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:03.459085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:03.460549 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:03.461238 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:03.461805 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] PATH_INFO: `/v3/projects/ca28b03f63b84862b4f0126609ec2219` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:03.464386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca28b03f63b84862b4f0126609ec2219)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:03.467566 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:03.596884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca28b03f63b84862b4f0126609ec2219', 'request_id': 'req-014f227f-b639-40cc-96f3-b5516671e712'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:03.607204 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca28b03f63b84862b4f0126609ec2219', 'request_id': 'req-014f227f-b639-40cc-96f3-b5516671e712'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:03.617886 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca28b03f63b84862b4f0126609ec2219', 'request_id': 'req-014f227f-b639-40cc-96f3-b5516671e712'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:03.639278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] The token cache is being invalidate because project ca28b03f63b84862b4f0126609ec2219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:09:03.640531 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:03.641451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-014f227f-b639-40cc-96f3-b5516671e712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:03.644942 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1382/2764] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:09:03 2022] DELETE /identity/v3/projects/ca28b03f63b84862b4f0126609ec2219 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:09:03.650093 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb5a38-a56f-46b5-9f6a-a0585dac56e4 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:03.650648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb5a38-a56f-46b5-9f6a-a0585dac56e4 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:03.650648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb5a38-a56f-46b5-9f6a-a0585dac56e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:03.671620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-15cb5a38-a56f-46b5-9f6a-a0585dac56e4 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:09:03.673478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-15cb5a38-a56f-46b5-9f6a-a0585dac56e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:03.704598 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:09:03.751139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1383/2765] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:09:03.760612 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fdfb8-1d3f-40f4-98a4-309778f79b37 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:03.761249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fdfb8-1d3f-40f4-98a4-309778f79b37 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:03.761249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fdfb8-1d3f-40f4-98a4-309778f79b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:03.794045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5b4fdfb8-1d3f-40f4-98a4-309778f79b37 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:09:03.796418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5b4fdfb8-1d3f-40f4-98a4-309778f79b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:03.815010 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1383/2766] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:09:03.821705 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb5a38-a56f-46b5-9f6a-a0585dac56e4 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:03.839604 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb5a38-a56f-46b5-9f6a-a0585dac56e4 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:03.844684 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0f7ba-ab51-4320-a5d2-1139929833b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:03.845378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f7ba-ab51-4320-a5d2-1139929833b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:03.845667 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f7ba-ab51-4320-a5d2-1139929833b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:03.845949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f7ba-ab51-4320-a5d2-1139929833b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:03.846703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0f7ba-ab51-4320-a5d2-1139929833b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:09:03.847023 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0f7ba-ab51-4320-a5d2-1139929833b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:03.850269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0f7ba-ab51-4320-a5d2-1139929833b8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:03.868367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1384/2767] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:09:03.874501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fdfb8-1d3f-40f4-98a4-309778f79b37 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:03.892077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fdfb8-1d3f-40f4-98a4-309778f79b37 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:03.901329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1a36-c271-4e52-9e67-86e67048e492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:03.902476 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1a36-c271-4e52-9e67-86e67048e492 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:03.902994 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1a36-c271-4e52-9e67-86e67048e492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:03.903562 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1a36-c271-4e52-9e67-86e67048e492 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:03.904906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a1a36-c271-4e52-9e67-86e67048e492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:03.908559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a1a36-c271-4e52-9e67-86e67048e492 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:03.961002 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1384/2768] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:09:03 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:09:03.967235 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0f7ba-ab51-4320-a5d2-1139929833b8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:03.986176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0f7ba-ab51-4320-a5d2-1139929833b8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:04.070573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add8848-b807-41cd-ad33-ba5babc09e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:04.071307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add8848-b807-41cd-ad33-ba5babc09e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:04.071605 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add8848-b807-41cd-ad33-ba5babc09e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:04.071889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add8848-b807-41cd-ad33-ba5babc09e69 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:04.072599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add8848-b807-41cd-ad33-ba5babc09e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:04.074760 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add8848-b807-41cd-ad33-ba5babc09e69 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:04.105595 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1385/2769] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:09:03 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:09:04.109579 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1a36-c271-4e52-9e67-86e67048e492 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:04.131231 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1a36-c271-4e52-9e67-86e67048e492 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:04.142831 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8c0c5-81e0-4e8f-a34e-a021559b7672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:04.144686 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8c0c5-81e0-4e8f-a34e-a021559b7672 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:04.148171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8c0c5-81e0-4e8f-a34e-a021559b7672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:04.148171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8c0c5-81e0-4e8f-a34e-a021559b7672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:04.148171 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8c0c5-81e0-4e8f-a34e-a021559b7672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:04.148655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8c0c5-81e0-4e8f-a34e-a021559b7672 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:04.171209 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1385/2770] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:09:04.173763 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add8848-b807-41cd-ad33-ba5babc09e69 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:04.189186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add8848-b807-41cd-ad33-ba5babc09e69 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:04.196087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3d71a-cde7-49db-a4b5-052bb1bd3b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:04.196826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d71a-cde7-49db-a4b5-052bb1bd3b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:04.197117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d71a-cde7-49db-a4b5-052bb1bd3b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:04.197399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d71a-cde7-49db-a4b5-052bb1bd3b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:04.198174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3d71a-cde7-49db-a4b5-052bb1bd3b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:04.199865 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3d71a-cde7-49db-a4b5-052bb1bd3b86 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:04.215839 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1386/2771] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:09:04.223006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8c0c5-81e0-4e8f-a34e-a021559b7672 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:04.244000 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8c0c5-81e0-4e8f-a34e-a021559b7672 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:04.253673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea78be-28e3-47d9-b523-f0c0a2b1d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:04.255917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea78be-28e3-47d9-b523-f0c0a2b1d0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:04.256364 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea78be-28e3-47d9-b523-f0c0a2b1d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:04.256800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea78be-28e3-47d9-b523-f0c0a2b1d0e9 admin admin] PATH_INFO: `/v3/projects/aa84da0910b84d6e800de624e02a8008/users/49082c79359046d4b36c8f2c31870876/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:04.278858 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea78be-28e3-47d9-b523-f0c0a2b1d0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa84da0910b84d6e800de624e02a8008, user_id=49082c79359046d4b36c8f2c31870876, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:04.283527 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea78be-28e3-47d9-b523-f0c0a2b1d0e9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:04.308224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1386/2772] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:09:04 2022] PUT /identity/v3/projects/aa84da0910b84d6e800de624e02a8008/users/49082c79359046d4b36c8f2c31870876/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:09:04.319587 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c88a-f2bd-4b33-a04e-92daf4b7e3d0 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:04.320042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c88a-f2bd-4b33-a04e-92daf4b7e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:04.320479 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c88a-f2bd-4b33-a04e-92daf4b7e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:04.365962 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5414c88a-f2bd-4b33-a04e-92daf4b7e3d0 None None] MFA Rules not processed for user `49082c79359046d4b36c8f2c31870876`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:09:04.368386 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5414c88a-f2bd-4b33-a04e-92daf4b7e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:04.464938 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1387/2773] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:09:04.478056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea78be-28e3-47d9-b523-f0c0a2b1d0e9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:04.480129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e0ea78be-28e3-47d9-b523-f0c0a2b1d0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:04.506671 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:09:04.557114 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea78be-28e3-47d9-b523-f0c0a2b1d0e9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:04.561838 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9df0d5-0508-4ee7-a5c5-a4431149ca38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:04.562513 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9df0d5-0508-4ee7-a5c5-a4431149ca38 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:04.562883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9df0d5-0508-4ee7-a5c5-a4431149ca38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:04.563072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9df0d5-0508-4ee7-a5c5-a4431149ca38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:04.573944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9df0d5-0508-4ee7-a5c5-a4431149ca38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:04.575575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9df0d5-0508-4ee7-a5c5-a4431149ca38 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:04.595493 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1387/2774] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:09:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:09:04.626149 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c88a-f2bd-4b33-a04e-92daf4b7e3d0 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:04.653161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:09:04.735230 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c88a-f2bd-4b33-a04e-92daf4b7e3d0 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:04.743672 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:04.745291 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:04.745807 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:04.746307 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] PATH_INFO: `/v3/users/49082c79359046d4b36c8f2c31870876` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:04.748868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49082c79359046d4b36c8f2c31870876)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:04.752845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:04.842139 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49082c79359046d4b36c8f2c31870876'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:04.859412 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49082c79359046d4b36c8f2c31870876'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:04.860646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49082c79359046d4b36c8f2c31870876'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:04.869506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49082c79359046d4b36c8f2c31870876'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:04.871497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49082c79359046d4b36c8f2c31870876'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:04.892757 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1388/2775] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:09:04 2022] DELETE /identity/v3/users/49082c79359046d4b36c8f2c31870876 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:09:04.899387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7192e-96bd-4c63-a8a5-48b56684e9e3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:04.900169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7192e-96bd-4c63-a8a5-48b56684e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:04.900169 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7192e-96bd-4c63-a8a5-48b56684e9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:04.918532 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-92a7192e-96bd-4c63-a8a5-48b56684e9e3 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:09:04.919912 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-92a7192e-96bd-4c63-a8a5-48b56684e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:05.025840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1388/2776] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:09:05.037135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:05.038709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:05.133910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37513025-6958-4fdd-97cc-cdc7a0d2d078 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:05.137983 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71076d-8bfc-4832-8f0b-2e731330d938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:05.138762 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71076d-8bfc-4832-8f0b-2e731330d938 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:05.139074 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71076d-8bfc-4832-8f0b-2e731330d938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:05.139411 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71076d-8bfc-4832-8f0b-2e731330d938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:05.150972 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71076d-8bfc-4832-8f0b-2e731330d938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:05.152484 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71076d-8bfc-4832-8f0b-2e731330d938 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:05.164579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1389/2777] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:09:05.717098 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7192e-96bd-4c63-a8a5-48b56684e9e3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:05.719903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-92a7192e-96bd-4c63-a8a5-48b56684e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:05.751015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7192e-96bd-4c63-a8a5-48b56684e9e3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:05.759314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:05.760818 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:05.761340 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:05.762031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] PATH_INFO: `/v3/projects/aa84da0910b84d6e800de624e02a8008` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:05.764418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa84da0910b84d6e800de624e02a8008)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:05.769014 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:05.852841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa84da0910b84d6e800de624e02a8008', 'request_id': 'req-26a86feb-91d7-463e-a7ec-068fe236535d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:05.860175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa84da0910b84d6e800de624e02a8008', 'request_id': 'req-26a86feb-91d7-463e-a7ec-068fe236535d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:05.867811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa84da0910b84d6e800de624e02a8008', 'request_id': 'req-26a86feb-91d7-463e-a7ec-068fe236535d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:05.889783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] The token cache is being invalidate because project aa84da0910b84d6e800de624e02a8008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:09:05.890600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:05.892062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-26a86feb-91d7-463e-a7ec-068fe236535d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:05.896990 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1389/2778] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:09:05 2022] DELETE /identity/v3/projects/aa84da0910b84d6e800de624e02a8008 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:09:05.909733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc747-9b73-4e65-a86a-f4b2fd55edcf None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:05.909733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc747-9b73-4e65-a86a-f4b2fd55edcf None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:05.909733 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc747-9b73-4e65-a86a-f4b2fd55edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:05.949967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-c5ecc747-9b73-4e65-a86a-f4b2fd55edcf None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:09:05.952032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-c5ecc747-9b73-4e65-a86a-f4b2fd55edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:05.997953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:09:06.030711 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1390/2779] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:09:06.096884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76960d4a-1191-4d74-8f3e-96005a679efc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:06.100676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76960d4a-1191-4d74-8f3e-96005a679efc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:06.101152 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76960d4a-1191-4d74-8f3e-96005a679efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:06.123122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-76960d4a-1191-4d74-8f3e-96005a679efc None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:09:06.124939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-76960d4a-1191-4d74-8f3e-96005a679efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:06.139229 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1390/2780] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:09:06.140758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecc747-9b73-4e65-a86a-f4b2fd55edcf None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:06.153174 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecc747-9b73-4e65-a86a-f4b2fd55edcf None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:06.161058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec68c52-8e5d-4715-882a-fd34439c6bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:06.161058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec68c52-8e5d-4715-882a-fd34439c6bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:06.165812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec68c52-8e5d-4715-882a-fd34439c6bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:06.165812 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec68c52-8e5d-4715-882a-fd34439c6bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:06.167085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec68c52-8e5d-4715-882a-fd34439c6bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:09:06.167854 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec68c52-8e5d-4715-882a-fd34439c6bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:06.170573 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec68c52-8e5d-4715-882a-fd34439c6bdd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:06.187206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1391/2781] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:09:06.191604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76960d4a-1191-4d74-8f3e-96005a679efc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:06.203090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76960d4a-1191-4d74-8f3e-96005a679efc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:06.208944 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2771d11-f06a-4d02-9fb1-3e15569884e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:06.210448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2771d11-f06a-4d02-9fb1-3e15569884e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:06.210796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2771d11-f06a-4d02-9fb1-3e15569884e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:06.211321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2771d11-f06a-4d02-9fb1-3e15569884e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:06.212522 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2771d11-f06a-4d02-9fb1-3e15569884e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:06.214033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2771d11-f06a-4d02-9fb1-3e15569884e2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:06.254107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1391/2782] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:09:06 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:09:06.255429 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec68c52-8e5d-4715-882a-fd34439c6bdd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:06.268918 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec68c52-8e5d-4715-882a-fd34439c6bdd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:06.347271 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d238fc-bc31-4a23-aa54-029dbd7ae33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:06.348000 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d238fc-bc31-4a23-aa54-029dbd7ae33e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:06.348280 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d238fc-bc31-4a23-aa54-029dbd7ae33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:06.348553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d238fc-bc31-4a23-aa54-029dbd7ae33e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:06.349315 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d238fc-bc31-4a23-aa54-029dbd7ae33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:06.351579 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d238fc-bc31-4a23-aa54-029dbd7ae33e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:06.380739 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1392/2783] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:09:06 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:09:06.382275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2771d11-f06a-4d02-9fb1-3e15569884e2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:06.394406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2771d11-f06a-4d02-9fb1-3e15569884e2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:06.400338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47572f82-82dc-452f-a60e-346a5c6ed9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:06.401094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47572f82-82dc-452f-a60e-346a5c6ed9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:06.401404 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47572f82-82dc-452f-a60e-346a5c6ed9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:06.401688 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47572f82-82dc-452f-a60e-346a5c6ed9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:06.402424 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47572f82-82dc-452f-a60e-346a5c6ed9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:06.404201 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47572f82-82dc-452f-a60e-346a5c6ed9c8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:06.417237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1392/2784] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:09:06.421449 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d238fc-bc31-4a23-aa54-029dbd7ae33e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:06.441591 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d238fc-bc31-4a23-aa54-029dbd7ae33e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:06.448047 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777435d-6511-46a7-aa60-77da28f21587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:06.448769 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777435d-6511-46a7-aa60-77da28f21587 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:06.449064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777435d-6511-46a7-aa60-77da28f21587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:06.449371 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777435d-6511-46a7-aa60-77da28f21587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:06.450886 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777435d-6511-46a7-aa60-77da28f21587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:06.453491 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777435d-6511-46a7-aa60-77da28f21587 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:06.467053 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1393/2785] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:09:06.471409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47572f82-82dc-452f-a60e-346a5c6ed9c8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:06.484275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47572f82-82dc-452f-a60e-346a5c6ed9c8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:06.489239 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94453ba-5861-41cd-b3a1-8c4007bdeaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:06.490906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94453ba-5861-41cd-b3a1-8c4007bdeaca admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:06.491246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94453ba-5861-41cd-b3a1-8c4007bdeaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:06.491537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94453ba-5861-41cd-b3a1-8c4007bdeaca admin admin] PATH_INFO: `/v3/projects/af4182b007464ce9bfb83e3f1e5bf8ce/users/dfce091bff84472dbb61afac3ad437b1/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:06.494409 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:09:06.514472 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94453ba-5861-41cd-b3a1-8c4007bdeaca admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4182b007464ce9bfb83e3f1e5bf8ce, user_id=dfce091bff84472dbb61afac3ad437b1, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:06.517282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94453ba-5861-41cd-b3a1-8c4007bdeaca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:06.539588 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1393/2786] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:09:06 2022] PUT /identity/v3/projects/af4182b007464ce9bfb83e3f1e5bf8ce/users/dfce091bff84472dbb61afac3ad437b1/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:09:06.550851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73803c8d-6109-41da-a214-419e51516672 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:06.551141 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73803c8d-6109-41da-a214-419e51516672 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:06.551456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73803c8d-6109-41da-a214-419e51516672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:06.592745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-73803c8d-6109-41da-a214-419e51516672 None None] MFA Rules not processed for user `dfce091bff84472dbb61afac3ad437b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:09:06.594574 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-73803c8d-6109-41da-a214-419e51516672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:06.720713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1394/2787] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:09:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:09:06.741327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94453ba-5861-41cd-b3a1-8c4007bdeaca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:06.744160 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d94453ba-5861-41cd-b3a1-8c4007bdeaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:06.836028 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94453ba-5861-41cd-b3a1-8c4007bdeaca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:06.840615 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e6ac-f71b-4dfd-9471-a9f0dac26880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:06.841500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e6ac-f71b-4dfd-9471-a9f0dac26880 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:06.841784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e6ac-f71b-4dfd-9471-a9f0dac26880 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:06.842101 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025e6ac-f71b-4dfd-9471-a9f0dac26880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:06.853903 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025e6ac-f71b-4dfd-9471-a9f0dac26880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:06.855881 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025e6ac-f71b-4dfd-9471-a9f0dac26880 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:06.868882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1394/2788] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:09:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:09:07.666577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad396a-5c4d-43fb-ad45-8006a2a16a78 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:07.667176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad396a-5c4d-43fb-ad45-8006a2a16a78 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:07.667176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad396a-5c4d-43fb-ad45-8006a2a16a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:07.686659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-87ad396a-5c4d-43fb-ad45-8006a2a16a78 None None] MFA Rules not processed for user `d6ebf747d4a04532aa201a23fb0094f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:09:07.687929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-87ad396a-5c4d-43fb-ad45-8006a2a16a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:07.721017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:09:07.757752 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1395/2789] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:09:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:09:09.645773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e6ac-f71b-4dfd-9471-a9f0dac26880 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:09.648203 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c025e6ac-f71b-4dfd-9471-a9f0dac26880 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:09.766190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025e6ac-f71b-4dfd-9471-a9f0dac26880 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:09.772791 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc118e0-1eab-450a-8a03-6a5c6fcf2c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:09.773952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc118e0-1eab-450a-8a03-6a5c6fcf2c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:09.774310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc118e0-1eab-450a-8a03-6a5c6fcf2c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:09.775105 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc118e0-1eab-450a-8a03-6a5c6fcf2c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:09.778083 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7fc118e0-1eab-450a-8a03-6a5c6fcf2c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:09.911040 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc118e0-1eab-450a-8a03-6a5c6fcf2c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:09.913609 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc118e0-1eab-450a-8a03-6a5c6fcf2c71 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:09.936812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1395/2790] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:09:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:09:15.019659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad396a-5c4d-43fb-ad45-8006a2a16a78 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:15.021855 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-87ad396a-5c4d-43fb-ad45-8006a2a16a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:15.034461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad396a-5c4d-43fb-ad45-8006a2a16a78 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:15.038951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08763514-8a09-478c-8c50-e8811802f6cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:15.039665 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763514-8a09-478c-8c50-e8811802f6cc service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:15.039948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763514-8a09-478c-8c50-e8811802f6cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:15.040217 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08763514-8a09-478c-8c50-e8811802f6cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:15.042064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-08763514-8a09-478c-8c50-e8811802f6cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:15.056543 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08763514-8a09-478c-8c50-e8811802f6cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:15.058040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08763514-8a09-478c-8c50-e8811802f6cc service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:15.070309 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1396/2791] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:09:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:09:17.614787 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc118e0-1eab-450a-8a03-6a5c6fcf2c71 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:17.657571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:09:17.701250 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc118e0-1eab-450a-8a03-6a5c6fcf2c71 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:17.706133 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:17.707025 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:17.707351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:17.707633 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] PATH_INFO: `/v3/users/dfce091bff84472dbb61afac3ad437b1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:17.710212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfce091bff84472dbb61afac3ad437b1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:17.712815 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:17.763765 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfce091bff84472dbb61afac3ad437b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:17.781139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfce091bff84472dbb61afac3ad437b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:17.788873 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfce091bff84472dbb61afac3ad437b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:17.789492 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfce091bff84472dbb61afac3ad437b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:17.796896 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfce091bff84472dbb61afac3ad437b1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:17.803389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1396/2792] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:09:17 2022] DELETE /identity/v3/users/dfce091bff84472dbb61afac3ad437b1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:09:17.808123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149feab8-ebd7-4892-b958-d583b2be3ff5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:17.808686 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149feab8-ebd7-4892-b958-d583b2be3ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:17.808686 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149feab8-ebd7-4892-b958-d583b2be3ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:17.828483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-149feab8-ebd7-4892-b958-d583b2be3ff5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:09:17.829889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-149feab8-ebd7-4892-b958-d583b2be3ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:17.894502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1397/2793] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:09:17.905044 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:17.906516 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:17.984154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479bfda-9b61-4431-9dc0-e0cb403f4752 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:17.988103 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9bad6-e187-449d-8577-74fb08c2797e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:17.988770 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9bad6-e187-449d-8577-74fb08c2797e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:17.989085 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9bad6-e187-449d-8577-74fb08c2797e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:17.989377 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9bad6-e187-449d-8577-74fb08c2797e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:17.999679 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9bad6-e187-449d-8577-74fb08c2797e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:18.001145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9bad6-e187-449d-8577-74fb08c2797e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:18.013015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1397/2794] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:09:18.350709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149feab8-ebd7-4892-b958-d583b2be3ff5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:18.352348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-149feab8-ebd7-4892-b958-d583b2be3ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:18.366648 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149feab8-ebd7-4892-b958-d583b2be3ff5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:18.371596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:18.372492 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:18.372827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:18.373111 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] PATH_INFO: `/v3/projects/af4182b007464ce9bfb83e3f1e5bf8ce` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:18.374396 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4182b007464ce9bfb83e3f1e5bf8ce)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:18.376448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:18.433450 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4182b007464ce9bfb83e3f1e5bf8ce', 'request_id': 'req-959b9567-fe14-47d4-9553-43a7d11daa21'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:18.439520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4182b007464ce9bfb83e3f1e5bf8ce', 'request_id': 'req-959b9567-fe14-47d4-9553-43a7d11daa21'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:18.448872 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4182b007464ce9bfb83e3f1e5bf8ce', 'request_id': 'req-959b9567-fe14-47d4-9553-43a7d11daa21'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:18.461740 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] The token cache is being invalidate because project af4182b007464ce9bfb83e3f1e5bf8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:09:18.462034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:18.462729 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:09:18.464339 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1398/2795] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:09:18 2022] DELETE /identity/v3/projects/af4182b007464ce9bfb83e3f1e5bf8ce => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:09:28.007280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=67,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:09:28.458206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:09:54.877811 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9bad6-e187-449d-8577-74fb08c2797e service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:54.897637 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9bad6-e187-449d-8577-74fb08c2797e service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:54.987147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4821a59-a10d-4b1b-a499-d2d8cee1928b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:54.987968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4821a59-a10d-4b1b-a499-d2d8cee1928b service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:54.989283 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4821a59-a10d-4b1b-a499-d2d8cee1928b service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:54.989829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4821a59-a10d-4b1b-a499-d2d8cee1928b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:54.992478 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b4821a59-a10d-4b1b-a499-d2d8cee1928b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:55.006730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4821a59-a10d-4b1b-a499-d2d8cee1928b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:55.008614 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4821a59-a10d-4b1b-a499-d2d8cee1928b service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:55.020167 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1398/2796] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:09:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:09:59.130028 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:09:59.131734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:59.149768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b9567-fe14-47d4-9553-43a7d11daa21 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:09:59.153888 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2da23b-ae84-4259-b33b-287478e94530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:09:59.154554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2da23b-ae84-4259-b33b-287478e94530 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:09:59.154842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2da23b-ae84-4259-b33b-287478e94530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:09:59.155122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2da23b-ae84-4259-b33b-287478e94530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:09:59.157155 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-df2da23b-ae84-4259-b33b-287478e94530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:09:59.241871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2da23b-ae84-4259-b33b-287478e94530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:09:59.243858 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2da23b-ae84-4259-b33b-287478e94530 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:09:59.256497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1399/2797] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:10:03.524469 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4821a59-a10d-4b1b-a499-d2d8cee1928b service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:10:03.527850 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b4821a59-a10d-4b1b-a499-d2d8cee1928b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:03.695539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4821a59-a10d-4b1b-a499-d2d8cee1928b service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:10:03.701159 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad75b10-36fb-4de5-8cd8-41c767203ca2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:10:03.701844 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad75b10-36fb-4de5-8cd8-41c767203ca2 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:03.702135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad75b10-36fb-4de5-8cd8-41c767203ca2 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:03.702421 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad75b10-36fb-4de5-8cd8-41c767203ca2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:03.704617 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0ad75b10-36fb-4de5-8cd8-41c767203ca2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:03.730695 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad75b10-36fb-4de5-8cd8-41c767203ca2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:10:03.732308 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad75b10-36fb-4de5-8cd8-41c767203ca2 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:10:03.753324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1399/2798] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:10:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:10:08.419058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2da23b-ae84-4259-b33b-287478e94530 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:10:08.421124 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-df2da23b-ae84-4259-b33b-287478e94530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:08.499713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2da23b-ae84-4259-b33b-287478e94530 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:10:08.506270 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:10:08.507333 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:08.507599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:08.507761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] PATH_INFO: `/v3/users/ba7c04a2d03a40e59dc665bb747b3ece` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:08.509031 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba7c04a2d03a40e59dc665bb747b3ece)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:10:08.511459 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:10:08.573014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba7c04a2d03a40e59dc665bb747b3ece'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:08.588405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba7c04a2d03a40e59dc665bb747b3ece'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:08.589474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba7c04a2d03a40e59dc665bb747b3ece'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:08.603133 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba7c04a2d03a40e59dc665bb747b3ece'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:08.604088 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba7c04a2d03a40e59dc665bb747b3ece'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:08.620961 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1400/2799] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:10:08 2022] DELETE /identity/v3/users/ba7c04a2d03a40e59dc665bb747b3ece => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:10:08.847466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad75b10-36fb-4de5-8cd8-41c767203ca2 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:10:08.900135 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad75b10-36fb-4de5-8cd8-41c767203ca2 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:10:08.970711 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:10:08.971618 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:08.971902 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:08.972178 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] PATH_INFO: `/v3/projects/e0e194c8baba46b5a1d9e6e895136378` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:08.973868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e194c8baba46b5a1d9e6e895136378)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:10:08.975889 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:10:08.987468 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:09.042141 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e194c8baba46b5a1d9e6e895136378', 'request_id': 'req-22855416-19b4-47e0-8b3d-8811b373c786'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.048929 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e194c8baba46b5a1d9e6e895136378', 'request_id': 'req-22855416-19b4-47e0-8b3d-8811b373c786'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.055658 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e194c8baba46b5a1d9e6e895136378', 'request_id': 'req-22855416-19b4-47e0-8b3d-8811b373c786'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.072150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] The token cache is being invalidate because project e0e194c8baba46b5a1d9e6e895136378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:10:09.072608 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.073840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.077129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1400/2800] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:10:08 2022] DELETE /identity/v3/projects/e0e194c8baba46b5a1d9e6e895136378 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:10:09.081206 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:10:09.083477 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:09.097837 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b50cc-8fd8-472c-bcd2-168dad7aa908 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:10:09.119771 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:09.195664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:10:09.196896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:09.197357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:09.197683 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] PATH_INFO: `/v3/users/533f9f262d2445ed83b6c0aaceae8f2e` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:09.199222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=533f9f262d2445ed83b6c0aaceae8f2e)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:10:09.201257 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:10:09.285100 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533f9f262d2445ed83b6c0aaceae8f2e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.305929 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533f9f262d2445ed83b6c0aaceae8f2e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.306794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533f9f262d2445ed83b6c0aaceae8f2e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.317104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533f9f262d2445ed83b6c0aaceae8f2e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.317952 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-c07b44ba-9599-4907-a753-2b161f0540f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533f9f262d2445ed83b6c0aaceae8f2e'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.343567 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1401/2801] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:10:09 2022] DELETE /identity/v3/users/533f9f262d2445ed83b6c0aaceae8f2e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:10:09.575145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:10:09.576960 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:09.606030 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22855416-19b4-47e0-8b3d-8811b373c786 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:10:09.698604 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:10:09.699530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:09.699821 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:09.700099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] PATH_INFO: `/v3/projects/29ecae8aed0c442e97bcc9498cf4d127` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:09.701346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ecae8aed0c442e97bcc9498cf4d127)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:10:09.703414 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:10:09.757883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ecae8aed0c442e97bcc9498cf4d127', 'request_id': 'req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.765279 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ecae8aed0c442e97bcc9498cf4d127', 'request_id': 'req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.772939 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ecae8aed0c442e97bcc9498cf4d127', 'request_id': 'req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.788406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] The token cache is being invalidate because project 29ecae8aed0c442e97bcc9498cf4d127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:10:09.788783 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.789544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:10:09.791437 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1401/2802] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:10:09 2022] DELETE /identity/v3/projects/29ecae8aed0c442e97bcc9498cf4d127 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:10:13.383680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c403ab-0974-4b1f-be84-ab3cb8123770 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:13.384222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c403ab-0974-4b1f-be84-ab3cb8123770 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:13.384663 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c403ab-0974-4b1f-be84-ab3cb8123770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:13.409200 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-08c403ab-0974-4b1f-be84-ab3cb8123770 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:10:13.410448 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-08c403ab-0974-4b1f-be84-ab3cb8123770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:13.493801 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1402/2803] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:10:13.548218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:10:13.551786 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:13.600820 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:13.650704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b35c7-5b05-4c12-b3d9-89d8e0915741 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:10:13.658601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895b4ba-bd99-458c-b49d-19d5afda54aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:10:13.659767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b4ba-bd99-458c-b49d-19d5afda54aa service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:13.660061 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b4ba-bd99-458c-b49d-19d5afda54aa service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:13.660387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b4ba-bd99-458c-b49d-19d5afda54aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:13.676051 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895b4ba-bd99-458c-b49d-19d5afda54aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:10:13.679386 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895b4ba-bd99-458c-b49d-19d5afda54aa service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:10:13.695883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1402/2804] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:10:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 16:10:23.486349 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:23.688454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=19 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:29.425404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbebf59-fc5c-4a40-8573-2a194f79461f None None] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:29.426798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbebf59-fc5c-4a40-8573-2a194f79461f None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:29.426798 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbebf59-fc5c-4a40-8573-2a194f79461f None None] PATH_INFO: `/` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:29.429418 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1403/2805] 10.222.0.46 () {54 vars in 921 bytes} [Tue Jun 21 16:10:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 16:10:29.437417 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ef2bf-f8c2-497a-8e30-fd5eb58a7850 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:29.438139 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ef2bf-f8c2-497a-8e30-fd5eb58a7850 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:29.438533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ef2bf-f8c2-497a-8e30-fd5eb58a7850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:29.464664 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-213ef2bf-f8c2-497a-8e30-fd5eb58a7850 None None] MFA Rules not processed for user `2ab989a935eb4d91a94611cededd3cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:10:29.466840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-213ef2bf-f8c2-497a-8e30-fd5eb58a7850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:29.593560 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1403/2806] 10.222.0.46 () {58 vars in 1018 bytes} [Tue Jun 21 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:10:29.606378 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbebf59-fc5c-4a40-8573-2a194f79461f None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:10:29.608375 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-9dbebf59-fc5c-4a40-8573-2a194f79461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:29.695795 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbebf59-fc5c-4a40-8573-2a194f79461f None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:10:29.700062 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74626051-2339-457d-8532-61c37444bd1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61565364dbac41cfac76195c0be88771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:10:29.700776 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74626051-2339-457d-8532-61c37444bd1d service glance] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:29.701068 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74626051-2339-457d-8532-61c37444bd1d service glance] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:29.701356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74626051-2339-457d-8532-61c37444bd1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:29.714013 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74626051-2339-457d-8532-61c37444bd1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:10:29.715640 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74626051-2339-457d-8532-61c37444bd1d service glance] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:10:29.729773 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1404/2807] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:10:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:10:31.878923 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7972fbe-ea46-4026-8f0d-8353e1f81fa4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:31.879655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7972fbe-ea46-4026-8f0d-8353e1f81fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:31.879655 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7972fbe-ea46-4026-8f0d-8353e1f81fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:31.900911 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a7972fbe-ea46-4026-8f0d-8353e1f81fa4 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:10:31.902191 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a7972fbe-ea46-4026-8f0d-8353e1f81fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:31.911146 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1404/2808] 10.222.0.46 () {58 vars in 1009 bytes} [Tue Jun 21 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:10:31.926545 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74626051-2339-457d-8532-61c37444bd1d service glance] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:10:31.944064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74626051-2339-457d-8532-61c37444bd1d service glance] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:10:31.949914 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdec31-400c-46fb-9833-bcd0a9675d6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:10:31.950627 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdec31-400c-46fb-9833-bcd0a9675d6e service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:31.950940 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdec31-400c-46fb-9833-bcd0a9675d6e service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:31.951273 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdec31-400c-46fb-9833-bcd0a9675d6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:31.961945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdec31-400c-46fb-9833-bcd0a9675d6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:10:31.963996 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdec31-400c-46fb-9833-bcd0a9675d6e service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:10:31.976041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1405/2809] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:10:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:10:41.893723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=34 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:41.970691 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=32 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:48.931112 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e1587-cdfc-49fe-81b3-98836935cb30 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:48.931833 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e1587-cdfc-49fe-81b3-98836935cb30 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:48.931833 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e1587-cdfc-49fe-81b3-98836935cb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:48.952934 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-209e1587-cdfc-49fe-81b3-98836935cb30 None None] MFA Rules not processed for user `3bc3da0a04de412eb239aeb0b2e99eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:10:48.954199 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-209e1587-cdfc-49fe-81b3-98836935cb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:10:48.962619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1405/2810] 10.222.0.46 () {58 vars in 967 bytes} [Tue Jun 21 16:10:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:10:49.022343 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdec31-400c-46fb-9833-bcd0a9675d6e service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:10:49.036034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdec31-400c-46fb-9833-bcd0a9675d6e service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:10:49.046819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2eabd4-9f38-4d42-9149-dab0bd79bc91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35ec9ea691c141eb86bf7a825fbb80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:10:49.049046 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eabd4-9f38-4d42-9149-dab0bd79bc91 service swift] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:10:49.049345 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eabd4-9f38-4d42-9149-dab0bd79bc91 service swift] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:10:49.049643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eabd4-9f38-4d42-9149-dab0bd79bc91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:10:49.062725 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2eabd4-9f38-4d42-9149-dab0bd79bc91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:10:49.067331 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2eabd4-9f38-4d42-9149-dab0bd79bc91 service swift] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:10:49.084649 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1406/2811] 10.222.0.46 () {60 vars in 1384 bytes} [Tue Jun 21 16:10:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 16:10:58.946842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:10:59.076892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:11:28.288352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e1587-cdfc-49fe-81b3-98836935cb30 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:28.289784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-209e1587-cdfc-49fe-81b3-98836935cb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:28.382188 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e1587-cdfc-49fe-81b3-98836935cb30 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:28.384062 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec2d8-9dcc-4b2f-a4ea-5ea212150ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:28.385454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec2d8-9dcc-4b2f-a4ea-5ea212150ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:28.385748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec2d8-9dcc-4b2f-a4ea-5ea212150ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:28.386036 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec2d8-9dcc-4b2f-a4ea-5ea212150ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:28.387988 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-843ec2d8-9dcc-4b2f-a4ea-5ea212150ce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:28.456658 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ec2d8-9dcc-4b2f-a4ea-5ea212150ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:28.458149 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ec2d8-9dcc-4b2f-a4ea-5ea212150ce2 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:28.468446 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1406/2812] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:11:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:11:31.700276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2eabd4-9f38-4d42-9149-dab0bd79bc91 service swift] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:31.703395 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fc2eabd4-9f38-4d42-9149-dab0bd79bc91 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:31.787310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2eabd4-9f38-4d42-9149-dab0bd79bc91 service swift] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:31.793770 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683f3ed-dd4c-497e-b341-1f3d6e038c32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:31.794520 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f3ed-dd4c-497e-b341-1f3d6e038c32 service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:31.794823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f3ed-dd4c-497e-b341-1f3d6e038c32 service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:31.795107 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f3ed-dd4c-497e-b341-1f3d6e038c32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:31.797426 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6683f3ed-dd4c-497e-b341-1f3d6e038c32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:31.817365 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683f3ed-dd4c-497e-b341-1f3d6e038c32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:31.821212 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683f3ed-dd4c-497e-b341-1f3d6e038c32 service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:31.841017 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1407/2813] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:11:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:11:35.885596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec2d8-9dcc-4b2f-a4ea-5ea212150ce2 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:35.887586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-843ec2d8-9dcc-4b2f-a4ea-5ea212150ce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:35.991086 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec2d8-9dcc-4b2f-a4ea-5ea212150ce2 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:35.995031 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007a7c-6510-4002-a841-06cdb437226d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:35.995722 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007a7c-6510-4002-a841-06cdb437226d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:35.996007 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007a7c-6510-4002-a841-06cdb437226d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:35.996283 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007a7c-6510-4002-a841-06cdb437226d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:35.998466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-55007a7c-6510-4002-a841-06cdb437226d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:36.039720 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:11:36.091406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55007a7c-6510-4002-a841-06cdb437226d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:36.092871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55007a7c-6510-4002-a841-06cdb437226d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:36.118081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1407/2814] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:11:39.854354 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683f3ed-dd4c-497e-b341-1f3d6e038c32 service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:39.856750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6683f3ed-dd4c-497e-b341-1f3d6e038c32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:39.878930 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683f3ed-dd4c-497e-b341-1f3d6e038c32 service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:39.884317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:39.885290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:39.885616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:39.886082 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] PATH_INFO: `/v3/users/d6ebf747d4a04532aa201a23fb0094f7` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:39.887618 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ebf747d4a04532aa201a23fb0094f7)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:39.890443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:39.956192 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ebf747d4a04532aa201a23fb0094f7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:11:39.977847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ebf747d4a04532aa201a23fb0094f7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:11:39.979438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ebf747d4a04532aa201a23fb0094f7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:11:39.996898 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ebf747d4a04532aa201a23fb0094f7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:11:39.998061 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-83c5638a-293e-4253-8f24-a0e81afeed4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ebf747d4a04532aa201a23fb0094f7'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:11:40.020755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1408/2815] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:11:39 2022] DELETE /identity/v3/users/d6ebf747d4a04532aa201a23fb0094f7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:11:40.245629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007a7c-6510-4002-a841-06cdb437226d service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:40.257558 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007a7c-6510-4002-a841-06cdb437226d service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:40.340940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:40.342519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:40.343012 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:40.343583 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] PATH_INFO: `/v3/projects/5e4ff5de3bbc44ca9f1b5559747b5c93` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:40.346022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4ff5de3bbc44ca9f1b5559747b5c93)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:40.349973 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:40.425601 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4ff5de3bbc44ca9f1b5559747b5c93', 'request_id': 'req-a1729653-9c72-4509-a0fa-37e73e2d1c89'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:11:40.432790 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4ff5de3bbc44ca9f1b5559747b5c93', 'request_id': 'req-a1729653-9c72-4509-a0fa-37e73e2d1c89'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:11:40.441240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4ff5de3bbc44ca9f1b5559747b5c93', 'request_id': 'req-a1729653-9c72-4509-a0fa-37e73e2d1c89'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:11:40.458324 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] The token cache is being invalidate because project 5e4ff5de3bbc44ca9f1b5559747b5c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:11:40.458793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:11:40.459696 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a1729653-9c72-4509-a0fa-37e73e2d1c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:11:40.461538 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1408/2816] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:11:40 2022] DELETE /identity/v3/projects/5e4ff5de3bbc44ca9f1b5559747b5c93 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:11:40.468851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a8593-bf31-4b5a-b5f4-26d8698d08ab None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:40.469146 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a8593-bf31-4b5a-b5f4-26d8698d08ab None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:40.469531 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a8593-bf31-4b5a-b5f4-26d8698d08ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:40.540971 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-8c0a8593-bf31-4b5a-b5f4-26d8698d08ab None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:11:40.542455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-8c0a8593-bf31-4b5a-b5f4-26d8698d08ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:40.617193 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1409/2817] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:11:40.629544 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de9035-db88-4733-83c1-6bbd591ac14c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:40.629834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de9035-db88-4733-83c1-6bbd591ac14c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:40.630115 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de9035-db88-4733-83c1-6bbd591ac14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:40.650313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-00de9035-db88-4733-83c1-6bbd591ac14c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:11:40.651666 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-00de9035-db88-4733-83c1-6bbd591ac14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:40.660753 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1409/2818] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:11:40.665566 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a8593-bf31-4b5a-b5f4-26d8698d08ab None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:40.671296 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:11:40.680168 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a8593-bf31-4b5a-b5f4-26d8698d08ab None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:40.685909 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239a36e-ed69-4ebe-bc92-5914347a387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:40.686874 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239a36e-ed69-4ebe-bc92-5914347a387d admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:40.687336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239a36e-ed69-4ebe-bc92-5914347a387d admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:40.687708 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239a36e-ed69-4ebe-bc92-5914347a387d admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:40.689438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239a36e-ed69-4ebe-bc92-5914347a387d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:11:40.689847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239a36e-ed69-4ebe-bc92-5914347a387d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:40.691646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239a36e-ed69-4ebe-bc92-5914347a387d admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:40.705370 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1410/2819] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:11:40.710072 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de9035-db88-4733-83c1-6bbd591ac14c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:40.720316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de9035-db88-4733-83c1-6bbd591ac14c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:40.725359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a2c47-b788-4064-ae24-73d58f805fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:40.726106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a2c47-b788-4064-ae24-73d58f805fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:40.726434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a2c47-b788-4064-ae24-73d58f805fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:40.726716 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a2c47-b788-4064-ae24-73d58f805fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:40.727517 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a2c47-b788-4064-ae24-73d58f805fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:40.729460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a2c47-b788-4064-ae24-73d58f805fb6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:40.760278 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1410/2820] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:11:40 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:11:40.765742 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239a36e-ed69-4ebe-bc92-5914347a387d admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:40.776910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239a36e-ed69-4ebe-bc92-5914347a387d admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:40.844001 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391448e-246d-4437-bf71-8168cb0001fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:40.844674 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391448e-246d-4437-bf71-8168cb0001fd admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:40.845601 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391448e-246d-4437-bf71-8168cb0001fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:40.845892 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391448e-246d-4437-bf71-8168cb0001fd admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:40.846620 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391448e-246d-4437-bf71-8168cb0001fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:40.848695 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391448e-246d-4437-bf71-8168cb0001fd admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:40.871048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1411/2821] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:11:40 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:11:40.875365 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a2c47-b788-4064-ae24-73d58f805fb6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:40.887342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a2c47-b788-4064-ae24-73d58f805fb6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:40.893533 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3933660-d3f7-4579-b909-07ff1d332c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:40.894253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3933660-d3f7-4579-b909-07ff1d332c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:40.894528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3933660-d3f7-4579-b909-07ff1d332c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:40.894815 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3933660-d3f7-4579-b909-07ff1d332c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:40.895869 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3933660-d3f7-4579-b909-07ff1d332c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:40.897515 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3933660-d3f7-4579-b909-07ff1d332c95 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:40.900268 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:11:40.912293 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1411/2822] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:11:40.918703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391448e-246d-4437-bf71-8168cb0001fd admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:40.930249 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391448e-246d-4437-bf71-8168cb0001fd admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:40.936348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb47f7-f775-4f91-95fe-4051d756fe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:40.937054 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb47f7-f775-4f91-95fe-4051d756fe67 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:40.937348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb47f7-f775-4f91-95fe-4051d756fe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:40.937638 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb47f7-f775-4f91-95fe-4051d756fe67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:40.938432 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb47f7-f775-4f91-95fe-4051d756fe67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:40.940173 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb47f7-f775-4f91-95fe-4051d756fe67 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:40.952748 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1412/2823] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:11:40.960056 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3933660-d3f7-4579-b909-07ff1d332c95 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:40.971530 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3933660-d3f7-4579-b909-07ff1d332c95 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:40.976606 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7163d-f526-4918-9add-47c5ac1f7314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:40.977528 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7163d-f526-4918-9add-47c5ac1f7314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:40.977814 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7163d-f526-4918-9add-47c5ac1f7314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:40.978099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7163d-f526-4918-9add-47c5ac1f7314 admin admin] PATH_INFO: `/v3/projects/e2c035da4e0048bbaabee8cd2a152c83/users/86e481ed8e6f402194732ba4cf5c4ccd/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:40.996050 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7163d-f526-4918-9add-47c5ac1f7314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c035da4e0048bbaabee8cd2a152c83, user_id=86e481ed8e6f402194732ba4cf5c4ccd, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:40.998834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7163d-f526-4918-9add-47c5ac1f7314 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:41.018607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1412/2824] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:11:40 2022] PUT /identity/v3/projects/e2c035da4e0048bbaabee8cd2a152c83/users/86e481ed8e6f402194732ba4cf5c4ccd/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:11:41.024755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e9640-f950-4f95-a906-485af209c5f6 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:41.025042 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e9640-f950-4f95-a906-485af209c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:41.025334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e9640-f950-4f95-a906-485af209c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:41.045415 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6a5e9640-f950-4f95-a906-485af209c5f6 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:11:41.046694 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6a5e9640-f950-4f95-a906-485af209c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:41.148301 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1413/2825] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:11:41.158772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7163d-f526-4918-9add-47c5ac1f7314 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:41.160798 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2f7163d-f526-4918-9add-47c5ac1f7314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:41.234373 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7163d-f526-4918-9add-47c5ac1f7314 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:41.239714 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538c885-9c52-4de9-b26e-d5e9dcdf39be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:41.240536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538c885-9c52-4de9-b26e-d5e9dcdf39be service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:41.240824 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538c885-9c52-4de9-b26e-d5e9dcdf39be service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:41.241240 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538c885-9c52-4de9-b26e-d5e9dcdf39be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:41.253865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538c885-9c52-4de9-b26e-d5e9dcdf39be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:41.255429 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538c885-9c52-4de9-b26e-d5e9dcdf39be service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:41.267937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1413/2826] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:11:46.616562 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690da367-e196-4868-abaa-951b3107c8de None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:46.617750 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690da367-e196-4868-abaa-951b3107c8de None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:46.618142 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690da367-e196-4868-abaa-951b3107c8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:46.652852 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-690da367-e196-4868-abaa-951b3107c8de None None] MFA Rules not processed for user `86e481ed8e6f402194732ba4cf5c4ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:11:46.654589 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-690da367-e196-4868-abaa-951b3107c8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:46.786999 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:11:46.793727 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1414/2827] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:11:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:11:46.816723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538c885-9c52-4de9-b26e-d5e9dcdf39be service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:46.818455 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e538c885-9c52-4de9-b26e-d5e9dcdf39be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:46.940834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538c885-9c52-4de9-b26e-d5e9dcdf39be service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:46.948828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ca09-17ba-47ba-9b4e-961026d657e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:46.949595 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ca09-17ba-47ba-9b4e-961026d657e6 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:46.949834 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ca09-17ba-47ba-9b4e-961026d657e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:46.950118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ca09-17ba-47ba-9b4e-961026d657e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:46.962825 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ca09-17ba-47ba-9b4e-961026d657e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:46.964815 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ca09-17ba-47ba-9b4e-961026d657e6 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:46.977564 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1414/2828] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:11:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:11:48.759032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bd7bf-8c3f-4e3a-a1e5-65ff25d0519a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:48.759882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bd7bf-8c3f-4e3a-a1e5-65ff25d0519a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:48.759882 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bd7bf-8c3f-4e3a-a1e5-65ff25d0519a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:48.782126 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ec9bd7bf-8c3f-4e3a-a1e5-65ff25d0519a None None] MFA Rules not processed for user `86e481ed8e6f402194732ba4cf5c4ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:11:48.783533 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ec9bd7bf-8c3f-4e3a-a1e5-65ff25d0519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:48.792435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1415/2829] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:11:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:11:49.239546 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ca09-17ba-47ba-9b4e-961026d657e6 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:49.241175 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cfc1ca09-17ba-47ba-9b4e-961026d657e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:49.254864 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ca09-17ba-47ba-9b4e-961026d657e6 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:49.260852 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7963e8f-5b50-4b6d-ae6c-ad707fa49c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:49.261575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7963e8f-5b50-4b6d-ae6c-ad707fa49c6b service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:49.262008 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7963e8f-5b50-4b6d-ae6c-ad707fa49c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:49.262131 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7963e8f-5b50-4b6d-ae6c-ad707fa49c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:49.264288 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b7963e8f-5b50-4b6d-ae6c-ad707fa49c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:49.276658 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7963e8f-5b50-4b6d-ae6c-ad707fa49c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:49.278326 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7963e8f-5b50-4b6d-ae6c-ad707fa49c6b service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:49.290561 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1415/2830] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:11:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:11:49.770319 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bd7bf-8c3f-4e3a-a1e5-65ff25d0519a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:49.772949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ec9bd7bf-8c3f-4e3a-a1e5-65ff25d0519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:49.893104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bd7bf-8c3f-4e3a-a1e5-65ff25d0519a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:49.901442 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183d924-aa32-4d01-8b39-20accc3d54ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:49.902187 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d924-aa32-4d01-8b39-20accc3d54ba service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:49.902475 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d924-aa32-4d01-8b39-20accc3d54ba service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:49.902823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d924-aa32-4d01-8b39-20accc3d54ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:49.904808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-a183d924-aa32-4d01-8b39-20accc3d54ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:49.918980 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183d924-aa32-4d01-8b39-20accc3d54ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:49.920646 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183d924-aa32-4d01-8b39-20accc3d54ba service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:49.945862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1416/2831] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:11:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:11:58.688505 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7963e8f-5b50-4b6d-ae6c-ad707fa49c6b service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:11:58.691415 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b7963e8f-5b50-4b6d-ae6c-ad707fa49c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:58.719150 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7963e8f-5b50-4b6d-ae6c-ad707fa49c6b service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:11:58.728964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c4957-dca2-4a22-9420-eac7a978550c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:11:58.730134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4957-dca2-4a22-9420-eac7a978550c service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:11:58.730656 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4957-dca2-4a22-9420-eac7a978550c service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:11:58.731194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4957-dca2-4a22-9420-eac7a978550c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:11:58.734385 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-218c4957-dca2-4a22-9420-eac7a978550c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:11:58.760081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c4957-dca2-4a22-9420-eac7a978550c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:11:58.762958 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c4957-dca2-4a22-9420-eac7a978550c service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:11:58.785371 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1416/2832] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:11:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:11:59.931511 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=36 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:12:08.777391 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:12:45.385510 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97be9e-5098-4bad-9fdc-57c71ca6325d None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:12:45.386436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97be9e-5098-4bad-9fdc-57c71ca6325d None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:12:45.386655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97be9e-5098-4bad-9fdc-57c71ca6325d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:12:45.407571 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-1b97be9e-5098-4bad-9fdc-57c71ca6325d None None] MFA Rules not processed for user `86e481ed8e6f402194732ba4cf5c4ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:12:45.408889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1b97be9e-5098-4bad-9fdc-57c71ca6325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:12:45.417162 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1417/2833] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:12:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:12:45.793901 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c4957-dca2-4a22-9420-eac7a978550c service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:12:45.805624 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c4957-dca2-4a22-9420-eac7a978550c service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:12:45.809964 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901495b9-580c-447e-b2bf-0271d2b5e5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:12:45.810766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901495b9-580c-447e-b2bf-0271d2b5e5cc service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:12:45.811058 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901495b9-580c-447e-b2bf-0271d2b5e5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:12:45.811906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901495b9-580c-447e-b2bf-0271d2b5e5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:12:45.813917 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-901495b9-580c-447e-b2bf-0271d2b5e5cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:12:45.825843 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901495b9-580c-447e-b2bf-0271d2b5e5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:12:45.827751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901495b9-580c-447e-b2bf-0271d2b5e5cc service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:12:45.838090 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1417/2834] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:12:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:12:47.824743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97be9e-5098-4bad-9fdc-57c71ca6325d None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:12:47.826463 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-1b97be9e-5098-4bad-9fdc-57c71ca6325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:12:47.876006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97be9e-5098-4bad-9fdc-57c71ca6325d None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:12:47.882201 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea124c15-4e76-44a3-bc79-8b21adab4521 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:12:47.883032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea124c15-4e76-44a3-bc79-8b21adab4521 service placement] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:12:47.883414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea124c15-4e76-44a3-bc79-8b21adab4521 service placement] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:12:47.883746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea124c15-4e76-44a3-bc79-8b21adab4521 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:12:47.885871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ea124c15-4e76-44a3-bc79-8b21adab4521 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:12:47.902436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea124c15-4e76-44a3-bc79-8b21adab4521 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:12:47.904117 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea124c15-4e76-44a3-bc79-8b21adab4521 service placement] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:12:47.917557 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1418/2835] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:12:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:12:55.833741 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:12:57.911530 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=18 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:13:52.266311 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238aab-3355-489b-8240-2b9c4d56cf21 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:13:52.267080 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238aab-3355-489b-8240-2b9c4d56cf21 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:13:52.267352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd238aab-3355-489b-8240-2b9c4d56cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:13:52.288473 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dd238aab-3355-489b-8240-2b9c4d56cf21 None None] MFA Rules not processed for user `86e481ed8e6f402194732ba4cf5c4ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:13:52.290049 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dd238aab-3355-489b-8240-2b9c4d56cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:13:52.297978 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1418/2836] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:13:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:14:02.281956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:14:43.209934 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea124c15-4e76-44a3-bc79-8b21adab4521 service placement] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:14:43.211480 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ea124c15-4e76-44a3-bc79-8b21adab4521 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:14:43.278466 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea124c15-4e76-44a3-bc79-8b21adab4521 service placement] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:14:43.282554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dd860-724f-462c-a22e-6a6581734fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:14:43.283266 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dd860-724f-462c-a22e-6a6581734fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:14:43.283559 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dd860-724f-462c-a22e-6a6581734fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:14:43.283844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dd860-724f-462c-a22e-6a6581734fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:14:43.285758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-104dd860-724f-462c-a22e-6a6581734fd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:14:43.301317 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dd860-724f-462c-a22e-6a6581734fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:14:43.302793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dd860-724f-462c-a22e-6a6581734fd5 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:14:43.317006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1419/2837] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:14:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:14:45.926466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238aab-3355-489b-8240-2b9c4d56cf21 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:14:45.928076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dd238aab-3355-489b-8240-2b9c4d56cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:14:45.946346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd238aab-3355-489b-8240-2b9c4d56cf21 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:14:45.951124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb29561-81e0-43c9-a413-4864383c919c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:14:45.951885 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb29561-81e0-43c9-a413-4864383c919c service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:14:45.952172 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb29561-81e0-43c9-a413-4864383c919c service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:14:45.952451 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb29561-81e0-43c9-a413-4864383c919c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:14:45.954356 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3fb29561-81e0-43c9-a413-4864383c919c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:14:45.971758 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb29561-81e0-43c9-a413-4864383c919c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:14:45.973228 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb29561-81e0-43c9-a413-4864383c919c service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:14:45.987122 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1419/2838] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:14:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:14:53.310512 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=26 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:14:55.357864 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796e800-52bf-418d-b821-b26bb61cf5de None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:14:55.358584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796e800-52bf-418d-b821-b26bb61cf5de None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:14:55.358584 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796e800-52bf-418d-b821-b26bb61cf5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:14:55.379461 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-4796e800-52bf-418d-b821-b26bb61cf5de None None] MFA Rules not processed for user `86e481ed8e6f402194732ba4cf5c4ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:14:55.380717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4796e800-52bf-418d-b821-b26bb61cf5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:14:55.388407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1420/2839] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:14:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:14:55.981142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:14:58.493212 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb29561-81e0-43c9-a413-4864383c919c service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:14:58.509967 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb29561-81e0-43c9-a413-4864383c919c service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:14:58.518427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc497441-fe63-4f6c-8a4c-54c49751dee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:14:58.518427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc497441-fe63-4f6c-8a4c-54c49751dee9 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:14:58.518956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc497441-fe63-4f6c-8a4c-54c49751dee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:14:58.519384 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc497441-fe63-4f6c-8a4c-54c49751dee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:14:58.523359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cc497441-fe63-4f6c-8a4c-54c49751dee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:14:58.541137 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc497441-fe63-4f6c-8a4c-54c49751dee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:14:58.544796 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc497441-fe63-4f6c-8a4c-54c49751dee9 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:14:58.560766 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1420/2840] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:14:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:15:05.373089 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:15:08.553947 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:15:10.103768 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796e800-52bf-418d-b821-b26bb61cf5de None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:15:10.128243 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796e800-52bf-418d-b821-b26bb61cf5de None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:15:10.139794 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae61ae-ceb3-4476-94b4-bc20fb5f105e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:15:10.140943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae61ae-ceb3-4476-94b4-bc20fb5f105e service nova] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:15:10.141716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae61ae-ceb3-4476-94b4-bc20fb5f105e service nova] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:15:10.142500 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae61ae-ceb3-4476-94b4-bc20fb5f105e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:15:10.146064 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-83ae61ae-ceb3-4476-94b4-bc20fb5f105e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:15:10.165352 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae61ae-ceb3-4476-94b4-bc20fb5f105e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:15:10.167644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae61ae-ceb3-4476-94b4-bc20fb5f105e service nova] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:15:10.180575 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1421/2841] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:15:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:15:20.175104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=6 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:05.916341 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc497441-fe63-4f6c-8a4c-54c49751dee9 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:05.936797 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc497441-fe63-4f6c-8a4c-54c49751dee9 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:05.947344 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19611ff5-272f-448e-a6f3-4d8704609ce7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:05.948825 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19611ff5-272f-448e-a6f3-4d8704609ce7 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:05.949427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19611ff5-272f-448e-a6f3-4d8704609ce7 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:05.949937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19611ff5-272f-448e-a6f3-4d8704609ce7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:05.952454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-19611ff5-272f-448e-a6f3-4d8704609ce7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:05.968654 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19611ff5-272f-448e-a6f3-4d8704609ce7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:05.971106 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19611ff5-272f-448e-a6f3-4d8704609ce7 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:05.989559 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1421/2842] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:16:06.008073 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae61ae-ceb3-4476-94b4-bc20fb5f105e service nova] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:06.035616 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae61ae-ceb3-4476-94b4-bc20fb5f105e service nova] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:06.044241 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:06.045455 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:06.045856 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:06.046259 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] PATH_INFO: `/v3/users/86e481ed8e6f402194732ba4cf5c4ccd` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:06.047866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e481ed8e6f402194732ba4cf5c4ccd)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:06.049992 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:06.124276 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e481ed8e6f402194732ba4cf5c4ccd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:06.139889 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e481ed8e6f402194732ba4cf5c4ccd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:06.140738 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e481ed8e6f402194732ba4cf5c4ccd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:06.150755 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e481ed8e6f402194732ba4cf5c4ccd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:06.151621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-b8980c41-f60a-45f1-8c48-254836e3c9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e481ed8e6f402194732ba4cf5c4ccd'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:06.172090 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1422/2843] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:16:06 2022] DELETE /identity/v3/users/86e481ed8e6f402194732ba4cf5c4ccd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:16:06.385042 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19611ff5-272f-448e-a6f3-4d8704609ce7 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:06.405390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19611ff5-272f-448e-a6f3-4d8704609ce7 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:06.487981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:06.488904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:06.489194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:06.489501 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] PATH_INFO: `/v3/projects/e2c035da4e0048bbaabee8cd2a152c83` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:06.490800 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c035da4e0048bbaabee8cd2a152c83)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:06.493416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:06.553265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c035da4e0048bbaabee8cd2a152c83', 'request_id': 'req-46359025-8b7f-4e2a-8eea-15e2125a089e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:06.560638 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c035da4e0048bbaabee8cd2a152c83', 'request_id': 'req-46359025-8b7f-4e2a-8eea-15e2125a089e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:06.568378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c035da4e0048bbaabee8cd2a152c83', 'request_id': 'req-46359025-8b7f-4e2a-8eea-15e2125a089e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:06.587893 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] The token cache is being invalidate because project e2c035da4e0048bbaabee8cd2a152c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:16:06.588248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:06.589116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46359025-8b7f-4e2a-8eea-15e2125a089e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:06.591142 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1422/2844] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:16:06 2022] DELETE /identity/v3/projects/e2c035da4e0048bbaabee8cd2a152c83 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:06.596692 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eb7d4-408d-4940-bf24-0ff704fc97f5 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:06.596990 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eb7d4-408d-4940-bf24-0ff704fc97f5 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:06.597299 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eb7d4-408d-4940-bf24-0ff704fc97f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:06.620361 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-784eb7d4-408d-4940-bf24-0ff704fc97f5 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:06.621726 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-784eb7d4-408d-4940-bf24-0ff704fc97f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:06.699716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1423/2845] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:06.710298 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730388b-83d1-443f-9f56-229d18c14370 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:06.710590 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730388b-83d1-443f-9f56-229d18c14370 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:06.710863 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730388b-83d1-443f-9f56-229d18c14370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:06.734433 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7730388b-83d1-443f-9f56-229d18c14370 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:06.735764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7730388b-83d1-443f-9f56-229d18c14370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:06.745449 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1423/2846] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:06.750247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784eb7d4-408d-4940-bf24-0ff704fc97f5 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:06.762156 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784eb7d4-408d-4940-bf24-0ff704fc97f5 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:06.767634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b711e58-ccb0-4ed1-9a73-8c496ec42bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:06.768383 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b711e58-ccb0-4ed1-9a73-8c496ec42bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:06.768720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b711e58-ccb0-4ed1-9a73-8c496ec42bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:06.769055 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b711e58-ccb0-4ed1-9a73-8c496ec42bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:06.770246 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b711e58-ccb0-4ed1-9a73-8c496ec42bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:16:06.770619 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b711e58-ccb0-4ed1-9a73-8c496ec42bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:06.772655 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b711e58-ccb0-4ed1-9a73-8c496ec42bd6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:06.788018 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1424/2847] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:16:06.797643 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730388b-83d1-443f-9f56-229d18c14370 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:06.809349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730388b-83d1-443f-9f56-229d18c14370 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:06.814953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe72f-ca75-478a-9e6b-f6b66ee92d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:06.815855 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe72f-ca75-478a-9e6b-f6b66ee92d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:06.816246 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe72f-ca75-478a-9e6b-f6b66ee92d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:06.816632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe72f-ca75-478a-9e6b-f6b66ee92d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:06.817460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fe72f-ca75-478a-9e6b-f6b66ee92d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:06.820218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fe72f-ca75-478a-9e6b-f6b66ee92d14 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:06.866704 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1424/2848] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:16:06 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:16:06.872245 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b711e58-ccb0-4ed1-9a73-8c496ec42bd6 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:06.883943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b711e58-ccb0-4ed1-9a73-8c496ec42bd6 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:07.000948 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee9e44-9501-4168-a229-31279b7b75ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:07.002181 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee9e44-9501-4168-a229-31279b7b75ce admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:07.002679 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee9e44-9501-4168-a229-31279b7b75ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:07.003199 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee9e44-9501-4168-a229-31279b7b75ce admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:07.004538 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee9e44-9501-4168-a229-31279b7b75ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:07.008495 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee9e44-9501-4168-a229-31279b7b75ce admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:07.020877 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:07.042834 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1425/2849] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:16:06 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:16:07.047454 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe72f-ca75-478a-9e6b-f6b66ee92d14 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:07.059329 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe72f-ca75-478a-9e6b-f6b66ee92d14 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:07.064982 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bbb60-0b37-4032-b1cd-4f9d3060ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:07.065751 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bbb60-0b37-4032-b1cd-4f9d3060ba97 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:07.066121 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bbb60-0b37-4032-b1cd-4f9d3060ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:07.066494 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bbb60-0b37-4032-b1cd-4f9d3060ba97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:07.067378 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bbb60-0b37-4032-b1cd-4f9d3060ba97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:07.069358 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bbb60-0b37-4032-b1cd-4f9d3060ba97 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:07.082109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1425/2850] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:07.088893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee9e44-9501-4168-a229-31279b7b75ce admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:07.100946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee9e44-9501-4168-a229-31279b7b75ce admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:07.106583 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16697fd1-2602-45ff-9468-5a68de3c9eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:07.107476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16697fd1-2602-45ff-9468-5a68de3c9eda admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:07.107866 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16697fd1-2602-45ff-9468-5a68de3c9eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:07.108249 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16697fd1-2602-45ff-9468-5a68de3c9eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:07.109178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16697fd1-2602-45ff-9468-5a68de3c9eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:07.111385 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16697fd1-2602-45ff-9468-5a68de3c9eda admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:07.126851 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1426/2851] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:07.135144 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bbb60-0b37-4032-b1cd-4f9d3060ba97 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:07.156237 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bbb60-0b37-4032-b1cd-4f9d3060ba97 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:07.163888 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267b9e9-5409-480f-9c74-c73cba4b6ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:07.165675 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b9e9-5409-480f-9c74-c73cba4b6ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:07.166379 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b9e9-5409-480f-9c74-c73cba4b6ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:07.166841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b9e9-5409-480f-9c74-c73cba4b6ec7 admin admin] PATH_INFO: `/v3/projects/e40b4717131746d0a5ab38e02841c6f6/users/b463d79ea54e4f3aa5393eea7b65e181/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:07.192582 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267b9e9-5409-480f-9c74-c73cba4b6ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40b4717131746d0a5ab38e02841c6f6, user_id=b463d79ea54e4f3aa5393eea7b65e181, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:07.195452 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267b9e9-5409-480f-9c74-c73cba4b6ec7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:07.212580 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1426/2852] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:16:07 2022] PUT /identity/v3/projects/e40b4717131746d0a5ab38e02841c6f6/users/b463d79ea54e4f3aa5393eea7b65e181/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:07.225238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a24d-27d5-4d48-a032-9346efe6c927 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:07.225819 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a24d-27d5-4d48-a032-9346efe6c927 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:07.226522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a24d-27d5-4d48-a032-9346efe6c927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:07.270822 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6034a24d-27d5-4d48-a032-9346efe6c927 None None] MFA Rules not processed for user `b463d79ea54e4f3aa5393eea7b65e181`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:07.272911 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6034a24d-27d5-4d48-a032-9346efe6c927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:07.351697 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1427/2853] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:07.363981 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267b9e9-5409-480f-9c74-c73cba4b6ec7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:07.366387 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6267b9e9-5409-480f-9c74-c73cba4b6ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:07.374351 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:07.475629 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267b9e9-5409-480f-9c74-c73cba4b6ec7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:07.484213 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee8bb7-46c7-4650-a65c-55ab1df8a0c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ab989a935eb4d91a94611cededd3cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:07.485033 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee8bb7-46c7-4650-a65c-55ab1df8a0c7 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:07.485416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee8bb7-46c7-4650-a65c-55ab1df8a0c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:07.485820 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee8bb7-46c7-4650-a65c-55ab1df8a0c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:07.505315 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee8bb7-46c7-4650-a65c-55ab1df8a0c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:07.507551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee8bb7-46c7-4650-a65c-55ab1df8a0c7 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:07.520639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1427/2854] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:16:10.375436 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a24d-27d5-4d48-a032-9346efe6c927 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:10.451384 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a24d-27d5-4d48-a032-9346efe6c927 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:10.459194 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:10.460503 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:10.460945 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:10.462015 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] PATH_INFO: `/v3/users/b463d79ea54e4f3aa5393eea7b65e181` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:10.464079 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b463d79ea54e4f3aa5393eea7b65e181)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:10.467720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:10.544797 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b463d79ea54e4f3aa5393eea7b65e181'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:10.560827 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b463d79ea54e4f3aa5393eea7b65e181'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:10.561634 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b463d79ea54e4f3aa5393eea7b65e181'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:10.567709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:10.572067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b463d79ea54e4f3aa5393eea7b65e181'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:10.573161 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b463d79ea54e4f3aa5393eea7b65e181'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:10.591051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1428/2855] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:16:10 2022] DELETE /identity/v3/users/b463d79ea54e4f3aa5393eea7b65e181 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:16:10.596303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b201e2-4746-4023-9495-c60e2f107c55 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:10.597162 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b201e2-4746-4023-9495-c60e2f107c55 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:10.597352 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b201e2-4746-4023-9495-c60e2f107c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:10.616915 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-34b201e2-4746-4023-9495-c60e2f107c55 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:10.619557 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-34b201e2-4746-4023-9495-c60e2f107c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:10.693633 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1428/2856] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:10.705267 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:10.706868 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:10.786734 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e7ee-0dc6-4342-9109-bbdc2df23843 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:10.791554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2eebba-8963-4d30-9693-c209a9b3c314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:10.792445 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2eebba-8963-4d30-9693-c209a9b3c314 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:10.792767 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2eebba-8963-4d30-9693-c209a9b3c314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:10.793175 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2eebba-8963-4d30-9693-c209a9b3c314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:10.803505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2eebba-8963-4d30-9693-c209a9b3c314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:10.805535 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2eebba-8963-4d30-9693-c209a9b3c314 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:10.817050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1429/2857] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:16:11.205170 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b201e2-4746-4023-9495-c60e2f107c55 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:11.207904 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-34b201e2-4746-4023-9495-c60e2f107c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:11.231323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b201e2-4746-4023-9495-c60e2f107c55 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:11.240310 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:11.243081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:11.243807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:11.245109 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] PATH_INFO: `/v3/projects/e40b4717131746d0a5ab38e02841c6f6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:11.248153 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40b4717131746d0a5ab38e02841c6f6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:11.251190 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:11.310180 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40b4717131746d0a5ab38e02841c6f6', 'request_id': 'req-79b3852b-a435-42ed-9811-35c5833c94d1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:11.317807 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40b4717131746d0a5ab38e02841c6f6', 'request_id': 'req-79b3852b-a435-42ed-9811-35c5833c94d1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:11.326193 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40b4717131746d0a5ab38e02841c6f6', 'request_id': 'req-79b3852b-a435-42ed-9811-35c5833c94d1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:11.343118 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] The token cache is being invalidate because project e40b4717131746d0a5ab38e02841c6f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:16:11.343438 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:11.344147 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-79b3852b-a435-42ed-9811-35c5833c94d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:11.345772 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1429/2858] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:16:11 2022] DELETE /identity/v3/projects/e40b4717131746d0a5ab38e02841c6f6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:11.356063 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522aa7-8319-4abb-be91-87703439dfc1 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:11.356478 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522aa7-8319-4abb-be91-87703439dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:11.357007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522aa7-8319-4abb-be91-87703439dfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:11.388182 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-bd522aa7-8319-4abb-be91-87703439dfc1 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:11.389838 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-bd522aa7-8319-4abb-be91-87703439dfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:11.478811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1430/2859] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:11.489224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398997-d16d-46e9-9d88-64e3678fc788 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:11.489730 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398997-d16d-46e9-9d88-64e3678fc788 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:11.490322 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398997-d16d-46e9-9d88-64e3678fc788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:11.522616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-45398997-d16d-46e9-9d88-64e3678fc788 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:11.525723 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-45398997-d16d-46e9-9d88-64e3678fc788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:11.540905 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1430/2860] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:11.545966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd522aa7-8319-4abb-be91-87703439dfc1 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:11.563279 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd522aa7-8319-4abb-be91-87703439dfc1 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:11.568105 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dcc02-4ebb-454f-942d-6bdf902ed263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:11.568784 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dcc02-4ebb-454f-942d-6bdf902ed263 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:11.569071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dcc02-4ebb-454f-942d-6bdf902ed263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:11.569346 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dcc02-4ebb-454f-942d-6bdf902ed263 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:11.570123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dcc02-4ebb-454f-942d-6bdf902ed263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:16:11.570474 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dcc02-4ebb-454f-942d-6bdf902ed263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:11.572841 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dcc02-4ebb-454f-942d-6bdf902ed263 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:11.586693 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1431/2861] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:16:11.591479 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398997-d16d-46e9-9d88-64e3678fc788 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:11.601445 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398997-d16d-46e9-9d88-64e3678fc788 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:11.606941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee303d-d78c-4ad1-b979-c7951a86eac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:11.607587 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee303d-d78c-4ad1-b979-c7951a86eac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:11.607875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee303d-d78c-4ad1-b979-c7951a86eac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:11.608154 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee303d-d78c-4ad1-b979-c7951a86eac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:11.608871 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee303d-d78c-4ad1-b979-c7951a86eac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:11.610826 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee303d-d78c-4ad1-b979-c7951a86eac8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:11.614668 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:11.655596 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1431/2862] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:16:11 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:16:11.659876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dcc02-4ebb-454f-942d-6bdf902ed263 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:11.672611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dcc02-4ebb-454f-942d-6bdf902ed263 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:11.744423 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e51649-05a1-4d62-bb96-0a639907d4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:11.745615 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51649-05a1-4d62-bb96-0a639907d4cf admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:11.746122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51649-05a1-4d62-bb96-0a639907d4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:11.746624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e51649-05a1-4d62-bb96-0a639907d4cf admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:11.747621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e51649-05a1-4d62-bb96-0a639907d4cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:11.750844 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e51649-05a1-4d62-bb96-0a639907d4cf admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:11.780594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1432/2863] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:16:11 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:16:11.784913 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee303d-d78c-4ad1-b979-c7951a86eac8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:11.796456 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee303d-d78c-4ad1-b979-c7951a86eac8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:11.801323 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e621d6f-35bf-49c2-af67-5044e3610671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:11.802007 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e621d6f-35bf-49c2-af67-5044e3610671 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:11.802300 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e621d6f-35bf-49c2-af67-5044e3610671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:11.802586 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e621d6f-35bf-49c2-af67-5044e3610671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:11.803401 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e621d6f-35bf-49c2-af67-5044e3610671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:11.805642 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e621d6f-35bf-49c2-af67-5044e3610671 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:11.817091 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1432/2864] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:11.822221 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e51649-05a1-4d62-bb96-0a639907d4cf admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:11.833444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e51649-05a1-4d62-bb96-0a639907d4cf admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:11.840238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74db88-be60-45ba-93fc-d0ab9dad91b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:11.841358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74db88-be60-45ba-93fc-d0ab9dad91b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:11.841651 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74db88-be60-45ba-93fc-d0ab9dad91b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:11.841960 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74db88-be60-45ba-93fc-d0ab9dad91b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:11.842709 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74db88-be60-45ba-93fc-d0ab9dad91b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:11.844404 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74db88-be60-45ba-93fc-d0ab9dad91b5 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:11.845991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:11.857981 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1433/2865] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:11.864497 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e621d6f-35bf-49c2-af67-5044e3610671 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:11.879865 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e621d6f-35bf-49c2-af67-5044e3610671 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:11.888507 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85235225-e47c-418e-b954-53082179b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:11.890017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235225-e47c-418e-b954-53082179b143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:11.890508 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235225-e47c-418e-b954-53082179b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:11.890951 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85235225-e47c-418e-b954-53082179b143 admin admin] PATH_INFO: `/v3/projects/7a0de7ae18cc4d04affed4a12be05a8c/users/e44942e24bac4fc4b52c17e760c92565/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:11.919605 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85235225-e47c-418e-b954-53082179b143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0de7ae18cc4d04affed4a12be05a8c, user_id=e44942e24bac4fc4b52c17e760c92565, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:11.924672 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85235225-e47c-418e-b954-53082179b143 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:11.948882 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1433/2866] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:16:11 2022] PUT /identity/v3/projects/7a0de7ae18cc4d04affed4a12be05a8c/users/e44942e24bac4fc4b52c17e760c92565/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:11.967119 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47e038-cc1e-4a56-a3b2-d5d86b674f69 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:11.967444 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47e038-cc1e-4a56-a3b2-d5d86b674f69 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:11.967717 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47e038-cc1e-4a56-a3b2-d5d86b674f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:11.998637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-6c47e038-cc1e-4a56-a3b2-d5d86b674f69 None None] MFA Rules not processed for user `e44942e24bac4fc4b52c17e760c92565`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:11.999977 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-6c47e038-cc1e-4a56-a3b2-d5d86b674f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:12.080597 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1434/2867] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:12.085724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85235225-e47c-418e-b954-53082179b143 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:12.156395 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85235225-e47c-418e-b954-53082179b143 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:12.161486 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d81a90-feb6-4d48-9099-18b9bae93836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:12.162174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d81a90-feb6-4d48-9099-18b9bae93836 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:12.162511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d81a90-feb6-4d48-9099-18b9bae93836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:12.162793 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d81a90-feb6-4d48-9099-18b9bae93836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:12.163571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d81a90-feb6-4d48-9099-18b9bae93836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:12.165874 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d81a90-feb6-4d48-9099-18b9bae93836 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:12.197788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1434/2868] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:16:12 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:16:12.202624 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47e038-cc1e-4a56-a3b2-d5d86b674f69 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:12.215287 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47e038-cc1e-4a56-a3b2-d5d86b674f69 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:12.296896 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c12bf-2200-4345-bf6a-a4e83f0a19d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:12.297599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c12bf-2200-4345-bf6a-a4e83f0a19d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:12.297890 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c12bf-2200-4345-bf6a-a4e83f0a19d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:12.298172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c12bf-2200-4345-bf6a-a4e83f0a19d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:12.298902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c12bf-2200-4345-bf6a-a4e83f0a19d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:12.300949 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c12bf-2200-4345-bf6a-a4e83f0a19d2 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:12.324997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1435/2869] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:16:12 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:16:12.329932 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d81a90-feb6-4d48-9099-18b9bae93836 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:12.343196 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d81a90-feb6-4d48-9099-18b9bae93836 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:12.348894 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b7b91-7123-4e60-8e5b-17d8c7e6a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:12.349660 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b7b91-7123-4e60-8e5b-17d8c7e6a4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:12.349972 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b7b91-7123-4e60-8e5b-17d8c7e6a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:12.350338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b7b91-7123-4e60-8e5b-17d8c7e6a4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:12.351275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b7b91-7123-4e60-8e5b-17d8c7e6a4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:12.353840 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b7b91-7123-4e60-8e5b-17d8c7e6a4fe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:12.366681 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1435/2870] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:16:12.373654 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c12bf-2200-4345-bf6a-a4e83f0a19d2 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:12.386357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c12bf-2200-4345-bf6a-a4e83f0a19d2 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:12.391793 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe680f-1628-4871-9547-c2a28efc2866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:12.392815 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe680f-1628-4871-9547-c2a28efc2866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:12.393176 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe680f-1628-4871-9547-c2a28efc2866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:12.393612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe680f-1628-4871-9547-c2a28efc2866 admin admin] PATH_INFO: `/v3/projects/a9d1f6d1b25147dd8b68a951ad075778/users/47a37027b5874c06af6f72cef76538f3/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:12.414051 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe680f-1628-4871-9547-c2a28efc2866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d1f6d1b25147dd8b68a951ad075778, user_id=47a37027b5874c06af6f72cef76538f3, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:12.417560 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe680f-1628-4871-9547-c2a28efc2866 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:12.436902 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1436/2871] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:16:12 2022] PUT /identity/v3/projects/a9d1f6d1b25147dd8b68a951ad075778/users/47a37027b5874c06af6f72cef76538f3/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:12.442285 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b7b91-7123-4e60-8e5b-17d8c7e6a4fe admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:12.464158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b7b91-7123-4e60-8e5b-17d8c7e6a4fe admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:12.546382 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d8f75-cee6-4fbf-965d-94083fe014f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:12.547071 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d8f75-cee6-4fbf-965d-94083fe014f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:12.547393 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d8f75-cee6-4fbf-965d-94083fe014f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:12.547673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d8f75-cee6-4fbf-965d-94083fe014f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:12.548418 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d8f75-cee6-4fbf-965d-94083fe014f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:12.550069 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d8f75-cee6-4fbf-965d-94083fe014f1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:12.567490 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1436/2872] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:12.572828 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe680f-1628-4871-9547-c2a28efc2866 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:12.584118 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe680f-1628-4871-9547-c2a28efc2866 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:12.589643 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba290e-c7aa-4382-a20f-1f6e511f4492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:12.590554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba290e-c7aa-4382-a20f-1f6e511f4492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:12.590842 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba290e-c7aa-4382-a20f-1f6e511f4492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:12.591123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba290e-c7aa-4382-a20f-1f6e511f4492 admin admin] PATH_INFO: `/v3/projects/a9d1f6d1b25147dd8b68a951ad075778/users/47a37027b5874c06af6f72cef76538f3/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:12.593340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba290e-c7aa-4382-a20f-1f6e511f4492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d1f6d1b25147dd8b68a951ad075778, user_id=47a37027b5874c06af6f72cef76538f3, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:12.596108 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba290e-c7aa-4382-a20f-1f6e511f4492 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:12.609523 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1437/2873] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:16:12 2022] PUT /identity/v3/projects/a9d1f6d1b25147dd8b68a951ad075778/users/47a37027b5874c06af6f72cef76538f3/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:12.620941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a355e6-af99-43c0-91ce-dbb8dbde6c1c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:12.621597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a355e6-af99-43c0-91ce-dbb8dbde6c1c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:12.621597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a355e6-af99-43c0-91ce-dbb8dbde6c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:12.654251 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a5a355e6-af99-43c0-91ce-dbb8dbde6c1c None None] MFA Rules not processed for user `47a37027b5874c06af6f72cef76538f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:12.655523 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a5a355e6-af99-43c0-91ce-dbb8dbde6c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:12.668448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:12.753432 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1437/2874] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:16:12.765924 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba290e-c7aa-4382-a20f-1f6e511f4492 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:12.767903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-15ba290e-c7aa-4382-a20f-1f6e511f4492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:12.826486 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:12.853223 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba290e-c7aa-4382-a20f-1f6e511f4492 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:12.857332 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f19e7c-daae-49d0-845d-943f934b6a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:12.858032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19e7c-daae-49d0-845d-943f934b6a40 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:12.858322 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19e7c-daae-49d0-845d-943f934b6a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:12.858622 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19e7c-daae-49d0-845d-943f934b6a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:12.936876 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f19e7c-daae-49d0-845d-943f934b6a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:12.938862 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f19e7c-daae-49d0-845d-943f934b6a40 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:12.950664 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1438/2875] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:16:15.640922 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a355e6-af99-43c0-91ce-dbb8dbde6c1c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:15.653402 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a355e6-af99-43c0-91ce-dbb8dbde6c1c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:15.657302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec8788-413e-4409-8c0b-d0148a7e47f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:15.657968 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec8788-413e-4409-8c0b-d0148a7e47f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:15.658257 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec8788-413e-4409-8c0b-d0148a7e47f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:15.658539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec8788-413e-4409-8c0b-d0148a7e47f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:15.672312 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec8788-413e-4409-8c0b-d0148a7e47f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:15.675314 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec8788-413e-4409-8c0b-d0148a7e47f6 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:15.696906 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1438/2876] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:16:22.944928 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=31 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:25.686539 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=31 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:28.947603 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f19e7c-daae-49d0-845d-943f934b6a40 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:29.032973 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f19e7c-daae-49d0-845d-943f934b6a40 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:29.040058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:29.041050 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:29.041405 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:29.041826 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] PATH_INFO: `/v3/users/e44942e24bac4fc4b52c17e760c92565` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:29.043506 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44942e24bac4fc4b52c17e760c92565)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:29.045946 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:29.110800 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44942e24bac4fc4b52c17e760c92565'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:29.126846 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44942e24bac4fc4b52c17e760c92565'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:29.128110 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44942e24bac4fc4b52c17e760c92565'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:29.140114 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44942e24bac4fc4b52c17e760c92565'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:29.140923 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44942e24bac4fc4b52c17e760c92565'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:29.158554 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1439/2877] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:16:28 2022] DELETE /identity/v3/users/e44942e24bac4fc4b52c17e760c92565 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:29.164234 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a97fda-1770-46f4-bfd5-bfc66b0a4a3f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:29.165174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a97fda-1770-46f4-bfd5-bfc66b0a4a3f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:29.165174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a97fda-1770-46f4-bfd5-bfc66b0a4a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:29.186952 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-44a97fda-1770-46f4-bfd5-bfc66b0a4a3f None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:29.188280 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-44a97fda-1770-46f4-bfd5-bfc66b0a4a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:29.263320 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1439/2878] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:29.273908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:29.276281 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:29.354237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44d804-6c52-4ca2-97b2-b42dc29a475a admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:29.358066 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182e63-96d9-4785-967a-eb9bbee08488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:29.358746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182e63-96d9-4785-967a-eb9bbee08488 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:29.359034 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182e63-96d9-4785-967a-eb9bbee08488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:29.359348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182e63-96d9-4785-967a-eb9bbee08488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:29.370706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182e63-96d9-4785-967a-eb9bbee08488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:29.372489 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182e63-96d9-4785-967a-eb9bbee08488 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:29.385502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1440/2879] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:16:29.715389 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a97fda-1770-46f4-bfd5-bfc66b0a4a3f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:29.717355 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-44a97fda-1770-46f4-bfd5-bfc66b0a4a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:29.734841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a97fda-1770-46f4-bfd5-bfc66b0a4a3f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:29.745003 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:29.746551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:29.747068 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:29.747676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] PATH_INFO: `/v3/projects/7a0de7ae18cc4d04affed4a12be05a8c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:29.750127 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0de7ae18cc4d04affed4a12be05a8c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:29.755673 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:29.826357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0de7ae18cc4d04affed4a12be05a8c', 'request_id': 'req-333edda4-f439-4437-a62a-e1e3491069b3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:29.834754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0de7ae18cc4d04affed4a12be05a8c', 'request_id': 'req-333edda4-f439-4437-a62a-e1e3491069b3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:29.842336 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0de7ae18cc4d04affed4a12be05a8c', 'request_id': 'req-333edda4-f439-4437-a62a-e1e3491069b3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:29.859593 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] The token cache is being invalidate because project 7a0de7ae18cc4d04affed4a12be05a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:16:29.859895 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:29.860776 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:29.862956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1440/2880] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:16:29 2022] DELETE /identity/v3/projects/7a0de7ae18cc4d04affed4a12be05a8c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:29.869407 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182e63-96d9-4785-967a-eb9bbee08488 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:29.880910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182e63-96d9-4785-967a-eb9bbee08488 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:29.918381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:29.978032 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:29.979091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:29.979091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:29.979462 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] PATH_INFO: `/v3/users/47a37027b5874c06af6f72cef76538f3` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:29.980713 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a37027b5874c06af6f72cef76538f3)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:29.982756 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:30.061657 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a37027b5874c06af6f72cef76538f3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:30.076122 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a37027b5874c06af6f72cef76538f3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:30.076893 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a37027b5874c06af6f72cef76538f3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:30.084731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a37027b5874c06af6f72cef76538f3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:30.085539 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-90c3b252-1b10-4388-b829-b9684ef6de69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a37027b5874c06af6f72cef76538f3'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:30.100903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1441/2881] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:16:29 2022] DELETE /identity/v3/users/47a37027b5874c06af6f72cef76538f3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:16:30.502930 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:30.504991 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:30.522591 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333edda4-f439-4437-a62a-e1e3491069b3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:30.602155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:30.603744 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:30.604253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:30.604740 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] PATH_INFO: `/v3/projects/a9d1f6d1b25147dd8b68a951ad075778` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:30.606993 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d1f6d1b25147dd8b68a951ad075778)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:30.610353 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:30.647750 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:30.672742 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d1f6d1b25147dd8b68a951ad075778', 'request_id': 'req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:30.682702 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d1f6d1b25147dd8b68a951ad075778', 'request_id': 'req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:30.689498 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d1f6d1b25147dd8b68a951ad075778', 'request_id': 'req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:30.713890 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] The token cache is being invalidate because project a9d1f6d1b25147dd8b68a951ad075778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:16:30.714248 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:30.715027 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f34e6647-c06b-4aa7-9cf2-0c23c86e68e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:30.716764 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1441/2882] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:16:30 2022] DELETE /identity/v3/projects/a9d1f6d1b25147dd8b68a951ad075778 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:16:30.729227 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24183d-921f-450d-8015-49c144145517 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:30.729563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24183d-921f-450d-8015-49c144145517 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:30.729779 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24183d-921f-450d-8015-49c144145517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:30.750967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-fb24183d-921f-450d-8015-49c144145517 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:30.752269 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-fb24183d-921f-450d-8015-49c144145517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:30.825178 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1442/2883] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:30.833158 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a33afd-2dc3-4b8e-b512-0e88fe5fe310 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:30.833621 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a33afd-2dc3-4b8e-b512-0e88fe5fe310 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:30.833997 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a33afd-2dc3-4b8e-b512-0e88fe5fe310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:30.857899 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b4a33afd-2dc3-4b8e-b512-0e88fe5fe310 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:30.859286 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b4a33afd-2dc3-4b8e-b512-0e88fe5fe310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:30.868821 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1442/2884] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:16:30.873563 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24183d-921f-450d-8015-49c144145517 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:30.885318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24183d-921f-450d-8015-49c144145517 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:30.890414 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35546b0b-d486-4a6c-bcfa-e6ac13a6078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:30.891154 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35546b0b-d486-4a6c-bcfa-e6ac13a6078e admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:30.891526 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35546b0b-d486-4a6c-bcfa-e6ac13a6078e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:30.891847 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35546b0b-d486-4a6c-bcfa-e6ac13a6078e admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:30.892659 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35546b0b-d486-4a6c-bcfa-e6ac13a6078e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:16:30.893040 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35546b0b-d486-4a6c-bcfa-e6ac13a6078e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:30.894831 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35546b0b-d486-4a6c-bcfa-e6ac13a6078e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:30.909873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1443/2885] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 16:16:30.914828 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a33afd-2dc3-4b8e-b512-0e88fe5fe310 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:30.924784 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a33afd-2dc3-4b8e-b512-0e88fe5fe310 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:30.930724 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447f60e-f393-4a4e-8582-339f85fda2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:30.931519 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447f60e-f393-4a4e-8582-339f85fda2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:30.931845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447f60e-f393-4a4e-8582-339f85fda2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:30.932125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447f60e-f393-4a4e-8582-339f85fda2d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:30.932845 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447f60e-f393-4a4e-8582-339f85fda2d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:30.934836 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447f60e-f393-4a4e-8582-339f85fda2d3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:30.966347 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1443/2886] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:16:30 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:16:30.971085 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35546b0b-d486-4a6c-bcfa-e6ac13a6078e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:30.983067 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35546b0b-d486-4a6c-bcfa-e6ac13a6078e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:31.016451 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:31.059059 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b76e-71fb-4e8f-bba4-9a13bb3d4126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:31.060041 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b76e-71fb-4e8f-bba4-9a13bb3d4126 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.060438 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b76e-71fb-4e8f-bba4-9a13bb3d4126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.060821 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b76e-71fb-4e8f-bba4-9a13bb3d4126 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.061631 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1b76e-71fb-4e8f-bba4-9a13bb3d4126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:31.063936 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1b76e-71fb-4e8f-bba4-9a13bb3d4126 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:31.088897 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1444/2887] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:16:30 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:16:31.094174 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447f60e-f393-4a4e-8582-339f85fda2d3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:31.110053 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447f60e-f393-4a4e-8582-339f85fda2d3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:31.115841 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8dbfc-19f2-4e24-9d95-005f75d8870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:31.117474 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8dbfc-19f2-4e24-9d95-005f75d8870d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.117880 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8dbfc-19f2-4e24-9d95-005f75d8870d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.118289 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8dbfc-19f2-4e24-9d95-005f75d8870d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.119124 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8dbfc-19f2-4e24-9d95-005f75d8870d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:31.120879 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8dbfc-19f2-4e24-9d95-005f75d8870d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:31.133434 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1444/2888] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:16:31.142808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b76e-71fb-4e8f-bba4-9a13bb3d4126 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:31.157330 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b76e-71fb-4e8f-bba4-9a13bb3d4126 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:31.162612 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6591ee3-28c0-4506-85df-7c2937eb6ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:31.163338 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6591ee3-28c0-4506-85df-7c2937eb6ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.163703 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6591ee3-28c0-4506-85df-7c2937eb6ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.164043 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6591ee3-28c0-4506-85df-7c2937eb6ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.164953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6591ee3-28c0-4506-85df-7c2937eb6ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:31.167264 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6591ee3-28c0-4506-85df-7c2937eb6ae6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:31.183381 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1445/2889] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:31.185847 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8dbfc-19f2-4e24-9d95-005f75d8870d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:31.197423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8dbfc-19f2-4e24-9d95-005f75d8870d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:31.202394 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd51e9-2c0b-484d-94f2-cdf94ccfe990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:31.203339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd51e9-2c0b-484d-94f2-cdf94ccfe990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.203625 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd51e9-2c0b-484d-94f2-cdf94ccfe990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.203909 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd51e9-2c0b-484d-94f2-cdf94ccfe990 admin admin] PATH_INFO: `/v3/projects/16e7e500ae474eab86f70853c82e156f/users/c31240f150534d9684e9473129c34505/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.221950 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd51e9-2c0b-484d-94f2-cdf94ccfe990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e7e500ae474eab86f70853c82e156f, user_id=c31240f150534d9684e9473129c34505, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:31.225048 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd51e9-2c0b-484d-94f2-cdf94ccfe990 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:31.243140 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1445/2890] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:16:31 2022] PUT /identity/v3/projects/16e7e500ae474eab86f70853c82e156f/users/c31240f150534d9684e9473129c34505/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:16:31.255058 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8ba1-ac70-47d0-83c3-3468beaa3fd3 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.255824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8ba1-ac70-47d0-83c3-3468beaa3fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.256340 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8ba1-ac70-47d0-83c3-3468beaa3fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.290903 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-5bff8ba1-ac70-47d0-83c3-3468beaa3fd3 None None] MFA Rules not processed for user `c31240f150534d9684e9473129c34505`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:31.292198 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-5bff8ba1-ac70-47d0-83c3-3468beaa3fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:31.406608 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1446/2891] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:31.411253 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd51e9-2c0b-484d-94f2-cdf94ccfe990 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:31.509089 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd51e9-2c0b-484d-94f2-cdf94ccfe990 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:31.516406 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d4cca-e037-44c2-8501-5f2bb979915a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:31.517269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d4cca-e037-44c2-8501-5f2bb979915a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.517632 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d4cca-e037-44c2-8501-5f2bb979915a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.517918 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d4cca-e037-44c2-8501-5f2bb979915a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.518914 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d4cca-e037-44c2-8501-5f2bb979915a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:31.521011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d4cca-e037-44c2-8501-5f2bb979915a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:31.569166 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1446/2892] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:16:31 2022] POST /identity/v3/projects => generated 399 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:16:31.574611 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff8ba1-ac70-47d0-83c3-3468beaa3fd3 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:31.596391 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff8ba1-ac70-47d0-83c3-3468beaa3fd3 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:31.668132 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2563e7-514c-4254-968f-afb4e495101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:31.668880 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2563e7-514c-4254-968f-afb4e495101e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.669290 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2563e7-514c-4254-968f-afb4e495101e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.669682 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2563e7-514c-4254-968f-afb4e495101e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.670516 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2563e7-514c-4254-968f-afb4e495101e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:31.672678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2563e7-514c-4254-968f-afb4e495101e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:31.699104 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1447/2893] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:16:31 2022] POST /identity/v3/users => generated 306 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:16:31.703542 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d4cca-e037-44c2-8501-5f2bb979915a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:31.718034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d4cca-e037-44c2-8501-5f2bb979915a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:31.724423 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0407-6cde-4fda-b9e9-7723c7bbfad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:31.725134 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0407-6cde-4fda-b9e9-7723c7bbfad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.725426 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0407-6cde-4fda-b9e9-7723c7bbfad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.725711 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0407-6cde-4fda-b9e9-7723c7bbfad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.727551 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f0407-6cde-4fda-b9e9-7723c7bbfad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:31.729339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f0407-6cde-4fda-b9e9-7723c7bbfad3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:31.744860 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1447/2894] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:31.750476 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2563e7-514c-4254-968f-afb4e495101e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:31.761731 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2563e7-514c-4254-968f-afb4e495101e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:31.766967 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852807-969a-4e4a-a04a-47f17d421983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:31.767966 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852807-969a-4e4a-a04a-47f17d421983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.768390 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852807-969a-4e4a-a04a-47f17d421983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.768680 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2852807-969a-4e4a-a04a-47f17d421983 admin admin] PATH_INFO: `/v3/projects/53894fd7203a4bd3b0314f3c4e677f84/users/c1f883995a0d4329bb63eb688b2b3d71/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.788087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2852807-969a-4e4a-a04a-47f17d421983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53894fd7203a4bd3b0314f3c4e677f84, user_id=c1f883995a0d4329bb63eb688b2b3d71, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:31.791487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2852807-969a-4e4a-a04a-47f17d421983 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:31.807706 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1448/2895] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:16:31 2022] PUT /identity/v3/projects/53894fd7203a4bd3b0314f3c4e677f84/users/c1f883995a0d4329bb63eb688b2b3d71/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:16:31.812303 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0407-6cde-4fda-b9e9-7723c7bbfad3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:31.824809 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0407-6cde-4fda-b9e9-7723c7bbfad3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:31.848511 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:31.896302 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6d546-d2fb-4209-8282-c1dccdf26244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:31.897249 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6d546-d2fb-4209-8282-c1dccdf26244 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.897534 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6d546-d2fb-4209-8282-c1dccdf26244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.897812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6d546-d2fb-4209-8282-c1dccdf26244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.898754 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6d546-d2fb-4209-8282-c1dccdf26244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:31.900600 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6d546-d2fb-4209-8282-c1dccdf26244 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:31.912218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1448/2896] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:31.917238 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852807-969a-4e4a-a04a-47f17d421983 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:31.923222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:31.934103 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2852807-969a-4e4a-a04a-47f17d421983 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:31.946487 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478fb1c-2aa2-43c6-8a2e-720b186c3be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:31.947701 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478fb1c-2aa2-43c6-8a2e-720b186c3be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.948135 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478fb1c-2aa2-43c6-8a2e-720b186c3be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.948464 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478fb1c-2aa2-43c6-8a2e-720b186c3be8 admin admin] PATH_INFO: `/v3/projects/53894fd7203a4bd3b0314f3c4e677f84/users/c1f883995a0d4329bb63eb688b2b3d71/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:31.950791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478fb1c-2aa2-43c6-8a2e-720b186c3be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53894fd7203a4bd3b0314f3c4e677f84, user_id=c1f883995a0d4329bb63eb688b2b3d71, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:31.953811 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478fb1c-2aa2-43c6-8a2e-720b186c3be8 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:31.966447 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1449/2897] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:16:31 2022] PUT /identity/v3/projects/53894fd7203a4bd3b0314f3c4e677f84/users/c1f883995a0d4329bb63eb688b2b3d71/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:31.979616 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c4f2e-19aa-409f-9b8d-9dd8c1a3e3dd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:31.980132 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c4f2e-19aa-409f-9b8d-9dd8c1a3e3dd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:31.980653 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c4f2e-19aa-409f-9b8d-9dd8c1a3e3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:32.055448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6c1c4f2e-19aa-409f-9b8d-9dd8c1a3e3dd None None] MFA Rules not processed for user `c1f883995a0d4329bb63eb688b2b3d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:32.057055 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6c1c4f2e-19aa-409f-9b8d-9dd8c1a3e3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:32.142947 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1449/2898] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:32.155871 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478fb1c-2aa2-43c6-8a2e-720b186c3be8 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:32.157900 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-e478fb1c-2aa2-43c6-8a2e-720b186c3be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:32.264957 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478fb1c-2aa2-43c6-8a2e-720b186c3be8 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:32.274553 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4e6e-a8ec-467a-bdb4-e944ed2be535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:32.275799 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4e6e-a8ec-467a-bdb4-e944ed2be535 service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:32.276337 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4e6e-a8ec-467a-bdb4-e944ed2be535 service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:32.276845 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4e6e-a8ec-467a-bdb4-e944ed2be535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:32.295087 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd4e6e-a8ec-467a-bdb4-e944ed2be535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:32.297975 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd4e6e-a8ec-467a-bdb4-e944ed2be535 service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:32.319513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1450/2899] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:16:32.417416 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c4f2e-19aa-409f-9b8d-9dd8c1a3e3dd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:32.436185 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c4f2e-19aa-409f-9b8d-9dd8c1a3e3dd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:32.443676 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacf075-f79a-4e07-b66a-bd0353a214cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:32.446470 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf075-f79a-4e07-b66a-bd0353a214cb service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:32.447552 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf075-f79a-4e07-b66a-bd0353a214cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:32.448022 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf075-f79a-4e07-b66a-bd0353a214cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:32.548359 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacf075-f79a-4e07-b66a-bd0353a214cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:32.549884 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacf075-f79a-4e07-b66a-bd0353a214cb service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:32.561262 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1450/2900] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:16:37.103399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4e6e-a8ec-467a-bdb4-e944ed2be535 service cinder] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:37.178762 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd4e6e-a8ec-467a-bdb4-e944ed2be535 service cinder] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:37.184434 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:37.185416 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:37.185728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:37.186008 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] PATH_INFO: `/v3/users/c31240f150534d9684e9473129c34505` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:37.187318 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31240f150534d9684e9473129c34505)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:37.189356 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:37.249120 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31240f150534d9684e9473129c34505'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:37.268950 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31240f150534d9684e9473129c34505'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:37.269758 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31240f150534d9684e9473129c34505'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:37.278885 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31240f150534d9684e9473129c34505'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:37.279937 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31240f150534d9684e9473129c34505'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:37.296698 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1451/2901] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:16:37 2022] DELETE /identity/v3/users/c31240f150534d9684e9473129c34505 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:37.301726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d994-5b1a-4f1f-8cc7-5f4819eeb6d8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:37.302321 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d994-5b1a-4f1f-8cc7-5f4819eeb6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:37.302460 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d994-5b1a-4f1f-8cc7-5f4819eeb6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:37.324317 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9349d994-5b1a-4f1f-8cc7-5f4819eeb6d8 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:37.325808 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9349d994-5b1a-4f1f-8cc7-5f4819eeb6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:37.375403 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:37.398919 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1451/2902] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:37.410172 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:37.411982 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:37.428879 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:37.486775 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3e8ba-389d-405c-b6ac-d2522cbc7fca admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:37.490720 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d5148-a4ac-4076-b8e8-e0551426c176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:37.491594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d5148-a4ac-4076-b8e8-e0551426c176 service neutron] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:37.492368 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d5148-a4ac-4076-b8e8-e0551426c176 service neutron] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:37.492641 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d5148-a4ac-4076-b8e8-e0551426c176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:37.503367 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d5148-a4ac-4076-b8e8-e0551426c176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:37.504746 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d5148-a4ac-4076-b8e8-e0551426c176 service neutron] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:37.517163 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1452/2903] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:16:37.858349 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349d994-5b1a-4f1f-8cc7-5f4819eeb6d8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:37.860941 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9349d994-5b1a-4f1f-8cc7-5f4819eeb6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:37.888711 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349d994-5b1a-4f1f-8cc7-5f4819eeb6d8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:37.897381 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:37.900313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:37.900748 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:37.901182 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] PATH_INFO: `/v3/projects/16e7e500ae474eab86f70853c82e156f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:37.903617 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e7e500ae474eab86f70853c82e156f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:37.907099 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:37.977529 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e7e500ae474eab86f70853c82e156f', 'request_id': 'req-a75e7e22-be68-4b28-bc83-865a57a6051a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:37.985316 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e7e500ae474eab86f70853c82e156f', 'request_id': 'req-a75e7e22-be68-4b28-bc83-865a57a6051a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:37.993466 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e7e500ae474eab86f70853c82e156f', 'request_id': 'req-a75e7e22-be68-4b28-bc83-865a57a6051a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.011691 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] The token cache is being invalidate because project 16e7e500ae474eab86f70853c82e156f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:16:38.012043 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.012883 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.015087 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1452/2904] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:16:37 2022] DELETE /identity/v3/projects/16e7e500ae474eab86f70853c82e156f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:38.019599 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d5148-a4ac-4076-b8e8-e0551426c176 service neutron] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:38.031353 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d5148-a4ac-4076-b8e8-e0551426c176 service neutron] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:38.119310 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:38.120221 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:38.120505 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:38.120778 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] PATH_INFO: `/v3/users/c1f883995a0d4329bb63eb688b2b3d71` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:38.122095 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f883995a0d4329bb63eb688b2b3d71)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:38.124154 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:38.191908 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f883995a0d4329bb63eb688b2b3d71'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.216116 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f883995a0d4329bb63eb688b2b3d71'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.216943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f883995a0d4329bb63eb688b2b3d71'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.225644 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f883995a0d4329bb63eb688b2b3d71'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.227106 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-bb8f3cc5-ae81-438c-b3f2-08716910d1fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f883995a0d4329bb63eb688b2b3d71'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.248171 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1453/2905] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:16:38 2022] DELETE /identity/v3/users/c1f883995a0d4329bb63eb688b2b3d71 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:16:38.594448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:38.596224 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:38.612578 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e7e22-be68-4b28-bc83-865a57a6051a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:38.705080 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:38.706639 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:38.707569 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:38.708094 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] PATH_INFO: `/v3/projects/53894fd7203a4bd3b0314f3c4e677f84` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:38.710861 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53894fd7203a4bd3b0314f3c4e677f84)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:38.714853 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:38.795343 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53894fd7203a4bd3b0314f3c4e677f84', 'request_id': 'req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.802726 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53894fd7203a4bd3b0314f3c4e677f84', 'request_id': 'req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.817780 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53894fd7203a4bd3b0314f3c4e677f84', 'request_id': 'req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.835006 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:38.845467 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] The token cache is being invalidate because project 53894fd7203a4bd3b0314f3c4e677f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:16:38.846045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.848261 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2df0da2b-8ca6-4e0b-8e32-3829aff067c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:38.851712 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1453/2906] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:16:38 2022] DELETE /identity/v3/projects/53894fd7203a4bd3b0314f3c4e677f84 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:16:38.857951 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece792f8-40ba-471b-b5b0-d6425143507a None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:38.858456 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece792f8-40ba-471b-b5b0-d6425143507a None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:38.858873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece792f8-40ba-471b-b5b0-d6425143507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:38.881678 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ece792f8-40ba-471b-b5b0-d6425143507a None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:38.884228 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ece792f8-40ba-471b-b5b0-d6425143507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:38.927637 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:38.970824 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1454/2907] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:38.982034 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2152f-0342-41f9-8f7f-65721d177d2c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:38.982554 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2152f-0342-41f9-8f7f-65721d177d2c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:38.983054 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2152f-0342-41f9-8f7f-65721d177d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.018427 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-65b2152f-0342-41f9-8f7f-65721d177d2c None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:39.020731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65b2152f-0342-41f9-8f7f-65721d177d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:39.037327 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1454/2908] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 16:16:39.042621 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece792f8-40ba-471b-b5b0-d6425143507a None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.053714 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece792f8-40ba-471b-b5b0-d6425143507a None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.059919 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6091e-a5d3-48bf-9ad1-f09bec572262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.060661 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6091e-a5d3-48bf-9ad1-f09bec572262 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.060953 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6091e-a5d3-48bf-9ad1-f09bec572262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.061237 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6091e-a5d3-48bf-9ad1-f09bec572262 admin admin] PATH_INFO: `/v3/domains` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.061998 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6091e-a5d3-48bf-9ad1-f09bec572262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80235) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 16:16:39.062314 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6091e-a5d3-48bf-9ad1-f09bec572262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.064007 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6091e-a5d3-48bf-9ad1-f09bec572262 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:39.078564 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1455/2909] 10.222.0.46 () {58 vars in 1152 bytes} [Tue Jun 21 16:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 16:16:39.083701 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2152f-0342-41f9-8f7f-65721d177d2c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.095361 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2152f-0342-41f9-8f7f-65721d177d2c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.100448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fff3d-b589-495f-8527-1cfd4d9112a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.101412 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fff3d-b589-495f-8527-1cfd4d9112a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.101755 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fff3d-b589-495f-8527-1cfd4d9112a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.102162 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fff3d-b589-495f-8527-1cfd4d9112a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.102956 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fff3d-b589-495f-8527-1cfd4d9112a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.105443 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fff3d-b589-495f-8527-1cfd4d9112a5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:39.141015 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1455/2910] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:16:39 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:16:39.145753 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6091e-a5d3-48bf-9ad1-f09bec572262 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.161737 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6091e-a5d3-48bf-9ad1-f09bec572262 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.235057 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb956b-e8b5-4ac2-9191-d5fd4af8c450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.235777 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb956b-e8b5-4ac2-9191-d5fd4af8c450 admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.236074 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb956b-e8b5-4ac2-9191-d5fd4af8c450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.236348 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb956b-e8b5-4ac2-9191-d5fd4af8c450 admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.237060 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb956b-e8b5-4ac2-9191-d5fd4af8c450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.239019 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb956b-e8b5-4ac2-9191-d5fd4af8c450 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:39.266765 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1456/2911] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:16:39 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:16:39.271471 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fff3d-b589-495f-8527-1cfd4d9112a5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.283506 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fff3d-b589-495f-8527-1cfd4d9112a5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.289081 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a002-ab3f-446c-9ab1-fbc8f3386570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.289774 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a002-ab3f-446c-9ab1-fbc8f3386570 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.290064 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a002-ab3f-446c-9ab1-fbc8f3386570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.290350 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a002-ab3f-446c-9ab1-fbc8f3386570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.291129 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856a002-ab3f-446c-9ab1-fbc8f3386570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.292812 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856a002-ab3f-446c-9ab1-fbc8f3386570 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:39.306220 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1456/2912] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:39.310529 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb956b-e8b5-4ac2-9191-d5fd4af8c450 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.322671 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb956b-e8b5-4ac2-9191-d5fd4af8c450 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.327745 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca07e07-c3ba-4b10-8dc8-9e6b68ea91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.328439 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca07e07-c3ba-4b10-8dc8-9e6b68ea91c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.328728 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca07e07-c3ba-4b10-8dc8-9e6b68ea91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.329014 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca07e07-c3ba-4b10-8dc8-9e6b68ea91c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.329761 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca07e07-c3ba-4b10-8dc8-9e6b68ea91c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.331430 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca07e07-c3ba-4b10-8dc8-9e6b68ea91c6 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:39.342991 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1457/2913] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:39.349376 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a002-ab3f-446c-9ab1-fbc8f3386570 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.361045 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a002-ab3f-446c-9ab1-fbc8f3386570 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.368060 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d227c9f-13e4-4189-ba00-eb3909b44bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.368500 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d227c9f-13e4-4189-ba00-eb3909b44bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.368829 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d227c9f-13e4-4189-ba00-eb3909b44bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.369155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d227c9f-13e4-4189-ba00-eb3909b44bfe admin admin] PATH_INFO: `/v3/projects/cc4c336504e1491cb00211fd83cb8545/users/edbd6aa1cfa74daca5952e20cb621ef3/roles/c78e303f11a84bcd80e78de27d7d26f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.388037 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d227c9f-13e4-4189-ba00-eb3909b44bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4c336504e1491cb00211fd83cb8545, user_id=edbd6aa1cfa74daca5952e20cb621ef3, role_id=c78e303f11a84bcd80e78de27d7d26f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.390792 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d227c9f-13e4-4189-ba00-eb3909b44bfe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:39.407773 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1457/2914] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:16:39 2022] PUT /identity/v3/projects/cc4c336504e1491cb00211fd83cb8545/users/edbd6aa1cfa74daca5952e20cb621ef3/roles/c78e303f11a84bcd80e78de27d7d26f2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:16:39.424358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20a3c6-4afe-4661-82fb-13090587da2e None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.424689 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20a3c6-4afe-4661-82fb-13090587da2e None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.424920 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20a3c6-4afe-4661-82fb-13090587da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.464006 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-2e20a3c6-4afe-4661-82fb-13090587da2e None None] MFA Rules not processed for user `edbd6aa1cfa74daca5952e20cb621ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:39.465277 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2e20a3c6-4afe-4661-82fb-13090587da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:39.555446 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1458/2915] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:16:39.561760 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d227c9f-13e4-4189-ba00-eb3909b44bfe admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.635502 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d227c9f-13e4-4189-ba00-eb3909b44bfe admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.640570 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71cd36-658e-4453-b670-58ebbb3ea8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.641265 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71cd36-658e-4453-b670-58ebbb3ea8ab admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.641556 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71cd36-658e-4453-b670-58ebbb3ea8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.641842 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71cd36-658e-4453-b670-58ebbb3ea8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.642571 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71cd36-658e-4453-b670-58ebbb3ea8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.644594 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71cd36-658e-4453-b670-58ebbb3ea8ab admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:39.676892 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1458/2916] 10.222.0.46 () {60 vars in 1152 bytes} [Tue Jun 21 16:16:39 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 16:16:39.682519 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20a3c6-4afe-4661-82fb-13090587da2e None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.696399 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20a3c6-4afe-4661-82fb-13090587da2e None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.729186 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:39.768522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085361d0-cda8-4515-bd4d-94f48b32408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.769364 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085361d0-cda8-4515-bd4d-94f48b32408e admin admin] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.769749 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085361d0-cda8-4515-bd4d-94f48b32408e admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.770138 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085361d0-cda8-4515-bd4d-94f48b32408e admin admin] PATH_INFO: `/v3/users` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.770943 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085361d0-cda8-4515-bd4d-94f48b32408e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.773397 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085361d0-cda8-4515-bd4d-94f48b32408e admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:39.796351 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1459/2917] 10.222.0.46 () {60 vars in 1143 bytes} [Tue Jun 21 16:16:39 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 16:16:39.800727 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71cd36-658e-4453-b670-58ebbb3ea8ab admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.812767 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71cd36-658e-4453-b670-58ebbb3ea8ab admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.818335 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715517f-161f-45b3-bd5f-65f7dea76e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.819254 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715517f-161f-45b3-bd5f-65f7dea76e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.820269 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715517f-161f-45b3-bd5f-65f7dea76e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.820442 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715517f-161f-45b3-bd5f-65f7dea76e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.821194 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715517f-161f-45b3-bd5f-65f7dea76e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.822875 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715517f-161f-45b3-bd5f-65f7dea76e96 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:39.836537 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1459/2918] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 16:16:39.841357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085361d0-cda8-4515-bd4d-94f48b32408e admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.852334 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085361d0-cda8-4515-bd4d-94f48b32408e admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.857234 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b790c9f-d381-4551-9de8-b6e90527dd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.858159 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b790c9f-d381-4551-9de8-b6e90527dd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.858443 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b790c9f-d381-4551-9de8-b6e90527dd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.858722 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b790c9f-d381-4551-9de8-b6e90527dd3c admin admin] PATH_INFO: `/v3/projects/146e261be0194cdc82721424e38cc626/users/d7a576638dd24fd8b585774e8ffe7941/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.877091 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b790c9f-d381-4551-9de8-b6e90527dd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=146e261be0194cdc82721424e38cc626, user_id=d7a576638dd24fd8b585774e8ffe7941, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.880287 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b790c9f-d381-4551-9de8-b6e90527dd3c admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:39.898462 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1460/2919] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:16:39 2022] PUT /identity/v3/projects/146e261be0194cdc82721424e38cc626/users/d7a576638dd24fd8b585774e8ffe7941/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:39.903041 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715517f-161f-45b3-bd5f-65f7dea76e96 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:39.913682 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715517f-161f-45b3-bd5f-65f7dea76e96 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:39.988867 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c171-85a8-40e0-9bc5-7fed9dbb1579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:39.989674 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c171-85a8-40e0-9bc5-7fed9dbb1579 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:39.990009 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c171-85a8-40e0-9bc5-7fed9dbb1579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:39.990436 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c171-85a8-40e0-9bc5-7fed9dbb1579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:39.991342 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038c171-85a8-40e0-9bc5-7fed9dbb1579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:39.993868 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038c171-85a8-40e0-9bc5-7fed9dbb1579 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:40.006940 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1460/2920] 10.222.0.46 () {58 vars in 1121 bytes} [Tue Jun 21 16:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 16:16:40.012941 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b790c9f-d381-4551-9de8-b6e90527dd3c admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:40.025112 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b790c9f-d381-4551-9de8-b6e90527dd3c admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:40.030360 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75c8f1-203d-402e-98ad-d56741922cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:40.031304 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c8f1-203d-402e-98ad-d56741922cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:40.031596 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c8f1-203d-402e-98ad-d56741922cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:40.031875 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c8f1-203d-402e-98ad-d56741922cfa admin admin] PATH_INFO: `/v3/projects/146e261be0194cdc82721424e38cc626/users/d7a576638dd24fd8b585774e8ffe7941/roles/29dae918965d40bea71d83ffa2085316` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:40.034048 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75c8f1-203d-402e-98ad-d56741922cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=146e261be0194cdc82721424e38cc626, user_id=d7a576638dd24fd8b585774e8ffe7941, role_id=29dae918965d40bea71d83ffa2085316)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:40.036823 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75c8f1-203d-402e-98ad-d56741922cfa admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:40.049416 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1461/2921] 10.222.0.46 () {60 vars in 1482 bytes} [Tue Jun 21 16:16:40 2022] PUT /identity/v3/projects/146e261be0194cdc82721424e38cc626/users/d7a576638dd24fd8b585774e8ffe7941/roles/29dae918965d40bea71d83ffa2085316 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:40.062339 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869d0ce-b694-4d3e-8535-ab86af43f210 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:40.062731 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869d0ce-b694-4d3e-8535-ab86af43f210 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:40.063023 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869d0ce-b694-4d3e-8535-ab86af43f210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:40.070575 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:40.095011 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1869d0ce-b694-4d3e-8535-ab86af43f210 None None] MFA Rules not processed for user `d7a576638dd24fd8b585774e8ffe7941`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:40.096304 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1869d0ce-b694-4d3e-8535-ab86af43f210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:40.181145 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1461/2922] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:16:40.192808 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75c8f1-203d-402e-98ad-d56741922cfa admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:40.195432 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-4a75c8f1-203d-402e-98ad-d56741922cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:40.266140 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75c8f1-203d-402e-98ad-d56741922cfa admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:40.270209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244b40c-9b61-4e00-ba8e-1d049b5ef98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6087f9fd3f814573a243f983faf0ce5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:40.270895 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244b40c-9b61-4e00-ba8e-1d049b5ef98e service cinder] REQUEST_METHOD: `GET` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:40.271209 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244b40c-9b61-4e00-ba8e-1d049b5ef98e service cinder] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:40.271497 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244b40c-9b61-4e00-ba8e-1d049b5ef98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:40.289716 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244b40c-9b61-4e00-ba8e-1d049b5ef98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:40.292247 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244b40c-9b61-4e00-ba8e-1d049b5ef98e service cinder] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:40.312123 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1462/2923] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:16:41.090346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869d0ce-b694-4d3e-8535-ab86af43f210 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:41.198338 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869d0ce-b694-4d3e-8535-ab86af43f210 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:41.208619 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:41.210592 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:41.211482 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:41.211999 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] PATH_INFO: `/v3/users/edbd6aa1cfa74daca5952e20cb621ef3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:41.214570 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbd6aa1cfa74daca5952e20cb621ef3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:41.218536 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:41.308306 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbd6aa1cfa74daca5952e20cb621ef3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:41.329116 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbd6aa1cfa74daca5952e20cb621ef3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:41.342313 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbd6aa1cfa74daca5952e20cb621ef3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:41.343259 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbd6aa1cfa74daca5952e20cb621ef3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:41.355275 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbd6aa1cfa74daca5952e20cb621ef3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:41.362380 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1462/2924] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:16:41 2022] DELETE /identity/v3/users/edbd6aa1cfa74daca5952e20cb621ef3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:41.368715 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c968-17a9-4066-88c0-52b2bc680c38 None None] REQUEST_METHOD: `POST` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:41.369552 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c968-17a9-4066-88c0-52b2bc680c38 None None] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:41.369873 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c968-17a9-4066-88c0-52b2bc680c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:41.393910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.auth.core [None req-ae61c968-17a9-4066-88c0-52b2bc680c38 None None] MFA Rules not processed for user `0a08a935c7f043a7a9ef4df0003ddf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80235) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 16:16:41.395357 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ae61c968-17a9-4066-88c0-52b2bc680c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:41.492628 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1463/2925] 10.222.0.46 () {58 vars in 957 bytes} [Tue Jun 21 16:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 16:16:41.505700 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:41.508360 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:41.521640 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:41.591136 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a72f4d-8322-42c6-893e-0326732ac432 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:41.595626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d68cd-2b67-4cf1-90e6-96d0e492b10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d3018419d0548eda04b3539681f3df5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:41.596607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d68cd-2b67-4cf1-90e6-96d0e492b10e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:41.596946 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d68cd-2b67-4cf1-90e6-96d0e492b10e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:41.597273 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d68cd-2b67-4cf1-90e6-96d0e492b10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:41.613694 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d68cd-2b67-4cf1-90e6-96d0e492b10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:41.617092 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d68cd-2b67-4cf1-90e6-96d0e492b10e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:41.637678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1463/2926] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 16:16:42.014743 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61c968-17a9-4066-88c0-52b2bc680c38 None None] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:42.017248 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-ae61c968-17a9-4066-88c0-52b2bc680c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:42.036435 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61c968-17a9-4066-88c0-52b2bc680c38 None None] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:42.044513 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:42.045577 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:42.045912 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:42.046240 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] PATH_INFO: `/v3/projects/cc4c336504e1491cb00211fd83cb8545` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:42.048075 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4c336504e1491cb00211fd83cb8545)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:42.052015 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:42.084437 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:42.121910 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4c336504e1491cb00211fd83cb8545', 'request_id': 'req-2729c6a4-72ce-436c-91c9-172030e61e42'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:42.128433 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4c336504e1491cb00211fd83cb8545', 'request_id': 'req-2729c6a4-72ce-436c-91c9-172030e61e42'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:42.140284 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4c336504e1491cb00211fd83cb8545', 'request_id': 'req-2729c6a4-72ce-436c-91c9-172030e61e42'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:42.154594 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] The token cache is being invalidate because project cc4c336504e1491cb00211fd83cb8545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:16:42.154974 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:42.155859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:42.157483 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1464/2927] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:16:42 2022] DELETE /identity/v3/projects/cc4c336504e1491cb00211fd83cb8545 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:42.162093 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d68cd-2b67-4cf1-90e6-96d0e492b10e service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:42.173626 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d68cd-2b67-4cf1-90e6-96d0e492b10e service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:42.242858 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:42.243788 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:42.244077 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:42.244357 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] PATH_INFO: `/v3/users/d7a576638dd24fd8b585774e8ffe7941` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:42.245678 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a576638dd24fd8b585774e8ffe7941)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:42.247690 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:42.320390 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a576638dd24fd8b585774e8ffe7941'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:42.340117 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a576638dd24fd8b585774e8ffe7941'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:42.351076 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a576638dd24fd8b585774e8ffe7941'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:42.352107 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a576638dd24fd8b585774e8ffe7941'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:42.360607 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a576638dd24fd8b585774e8ffe7941'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:42.368218 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1464/2928] 10.222.0.46 () {58 vars in 1223 bytes} [Tue Jun 21 16:16:42 2022] DELETE /identity/v3/users/d7a576638dd24fd8b585774e8ffe7941 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 16:16:42.974336 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] Authenticating user token {{(pid=80235) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:16:42.976590 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.fernet_utils [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80235) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:16:43.004633 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729c6a4-72ce-436c-91c9-172030e61e42 admin admin] Validating token access rules against request {{(pid=80235) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:16:43.080614 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a08a935c7f043a7a9ef4df0003ddf4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f406bc3b64324ae8acf4eaa5547534ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80235) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:16:43.081502 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:16:43.081791 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:16:43.082071 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] PATH_INFO: `/v3/projects/146e261be0194cdc82721424e38cc626` {{(pid=80235) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:16:43.083358 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=146e261be0194cdc82721424e38cc626)` {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:16:43.086859 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] RBAC: Authorization granted {{(pid=80235) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:16:43.155522 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '146e261be0194cdc82721424e38cc626', 'request_id': 'req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:43.163921 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '146e261be0194cdc82721424e38cc626', 'request_id': 'req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:43.177810 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '146e261be0194cdc82721424e38cc626', 'request_id': 'req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298'} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:43.193997 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] The token cache is being invalidate because project 146e261be0194cdc82721424e38cc626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80235) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 16:16:43.194282 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:43.196185 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG keystone.notifications [None req-f454b3af-5d0e-4d84-81fd-c3ef61e0c298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80235) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 16:16:43.197843 dv-cinder-840678-13-smb devstack@keystone.service[80235]: [pid: 80235|app: 0|req: 1465/2929] 10.222.0.46 () {58 vars in 1232 bytes} [Tue Jun 21 16:16:42 2022] DELETE /identity/v3/projects/146e261be0194cdc82721424e38cc626 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 16:16:52.363597 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:16:53.190222 dv-cinder-840678-13-smb devstack@keystone.service[80235]: DEBUG dbcounter [-] [80235] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80235) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 16:17:53.815125 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 16:17:53.816958 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:17:53.910937 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a564b-734e-421b-938d-16a22c3f5f3d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 16:17:54.000453 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d7aa4-e618-4f54-b397-599fb9b4ea23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1aeacb83a142db99823f29bd1b7cce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad1bfffe83744bed97a69a07ec777d92', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 16:17:54.001155 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d7aa4-e618-4f54-b397-599fb9b4ea23 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 16:17:54.001448 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d7aa4-e618-4f54-b397-599fb9b4ea23 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 16:17:54.001732 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d7aa4-e618-4f54-b397-599fb9b4ea23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 16:17:54.004017 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-842d7aa4-e618-4f54-b397-599fb9b4ea23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 16:17:54.018346 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d7aa4-e618-4f54-b397-599fb9b4ea23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 16:17:54.019938 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d7aa4-e618-4f54-b397-599fb9b4ea23 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 16:17:54.033282 dv-cinder-840678-13-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1465/2930] 10.222.0.46 () {60 vars in 1365 bytes} [Tue Jun 21 16:17:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 16:18:04.027953 dv-cinder-840678-13-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=58 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}